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Abstract 

In this paper we present an alternative method for the spectral analysis of a strictly 
stationary time series {Yt}te'L- We define a "new" spectrum as the Fourier transform of the 
differences between copulas of the pairs (It, i^_fc) and the independence copula. This object 
is called copula spectral density kernel and allows to separate marginal and serial aspects of a 
time series. We show that it is intrinsically related to the concept of quantile regression. Like 
in quantile regression, which provides more information about the conditional distribution 
than the classical location-scale model, the copula spectral density kernel is more informative 
than the spectral density obtained from the autocovariances. In particular the approach 
provides a complete description of the distributions of all pairs {Yt,Yt-k)- Moreover, it 
inherits the robustness properties of classical quantile regression, because it does not require 
any distributional assumptions such as the existence of finite moments. In order to estimate 
the copula spectral density kernel we introduce rank-based Laplace periodograms which 
are calculated as bilinear forms of weighted Li-projections of the ranks of the observed 
time series onto a harmonic regression model. We establish the asymptotic distribution of 
those periodograms, and the consistency of adequately smoothed versions. The finite-sample 
properties of the new methodology, and its potential for applications are briefly investigated 
by simulations and a short empirical example. 

AMS 1980 subject classification : 62M15, 62G35. 
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1 Introduction. 

1.1 The location-scale paradigm. 

Whether linear or not, most traditional time series models are of the conditional location/scale 
type: conditional on past values Yt-i,Yt-2j • ■ •, the random variable Yt satisfies an equation of 
the form 

Yt = i;{Yt-i,Yt-2,...) + (T{Yt^r,Yt-2,...)et teZ, (1.1) 
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where {et}t£'z is white noise, and et is independent of Yt-i,Yt-2, ■ ■ ■ ■ The {Yt-i,Yt-2, ■ ■ ■ )- 
measurable functions ip and a are (conditional) location and scale functions, possibly para- 



metrized by some i?. Equation (1.1) may characterize a data-generating process - in which 
case "=" is to be considered as "almost sure equality" - or, more generally, it simply describes 
If's conditional (on Yt-i,Yt-2, ■ ■ ■ ) distribution - and "=" is to be interpreted as "equality in 
(conditional) distribution". Such distinction is, however, irrelevant from a statistical point of 
view, as it has no impact on likelihoods. 



In model (1.1), the distribution of Yj conditional on Yt-i,Yt-2, ... is nothing but the dis- 
tribution of et, rescaled by the conditional scale parameter a{Yt-i, Yt-2, ■ ■ ■ ) and shifted by the 
conditional location parameter ip{Yt-i, Yt-2, ■ ■ ■ )■ Sophisticated as they may be, the mappings 

{Yt-uYt-2, . . . ) ^ {^{Yt-i,Yt.2, ...), a{Yt-i,Yt-2, • • • )) 

only can account for a very limited type of the dynamics of the process {Yt}te'Z- The dynamics of 
volatility provided by this model are quite poor, being of a pure rescaling nature. In particular no 
impact of past values on skewness, kurtosis, tails, can be reflected. All standardized conditional 
distributions strictly coincide with that of e, and all conditional r-quantiles, hence all values at 
risk, follow, irrespective of r, from those of e via one single linear transformation. 

Note that the interpretation of ■0 and a depends on the identification constraints on e: if e 
is assumed to have mean zero and variance one, then ip and a are a conditional mean and a 



conditional standard error, respectively. In this case models of the form (1.1) clearly belong to 
the L2-Gaussian legacy. If e is assumed to have median zero and expected absolute deviation 
or median absolute deviation one, ip and a are a conditional median and a conditional expected 
or median absolute deviation. 

On the basis of these "remarks" , the following questions naturally arise: Can we do better? 
Can we go beyond that (conditional) "location-scale paradigm" ? Can we model richer dynamics 
under which the conditional quantiles of Y are not just a shifted and rescaled version of those 
of e and under which the whole conditional distribution of Yj, not just its location and scale, 
can be affected by the past? And, can we achieve this in a statistically tractable way? 

1.2 Marginal and serial features. 



Another drawback of models of the form (1.1) is their sensitivity to nonlinear marginal trans- 
formations. If two statisticians observe the same time series, but measure it on different scales, 
Yt and Y^ or e^*, for instance, and both adjust a model of the form ( 1.1 ) to their measurements, 



they will end up with drastically different analyses and predictions. The only way to avoid 
this problem consists in disentangling the marginal (viz., related to the scale of measurement) 
aspects of the series under study from its serial aspects, that is, basing the description of serial 
dependence features on quantities such as the i<V(Yt)'s, where Fy is Ij's marginal distribution 
function. Those quantities do not depend on the measurement scale since they are invariant 
under continuous monotone increasing transformations. 

This point of view is closely related to the concept of copulas (see Nelsen |2006| or Genest 



and Favre [2007| ). Consider, for instance, a strictly stationary Markovian process {l^tjtez of 
order one. This process is fully characterized by the joint distribution of (Yj,lt_i) or, equiva- 
lently, by the marginal distribution function Fy (or the quantile function Fy^) of Yt, along with 
the joint distribution of {Ut,Ut-i) := {Fy{Yt), Fy{Yt-i)), a "serial copula of order one". In 
such a description, the marginal features of the process {Yt}tez are entirely described by Fy, 
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independently of the serial features, that are accounted for by the serial copula. Two statisti- 
cians observing the same phenomenon but recording Yt and e^* , respectively, would use distinct 
quantile functions, but they would agree on serial features. 

In more general cases, serial copulas of order one are not sufficient, and higher-order or 
multiple copulas may be needed. Note that the description of the model in this context is 
clearly "in distribution": Ut is not related to Ut~i through any direct interpretable "almost sure 
relation" reflecting some "physical" data-generating mechanism. 



1.3 A new nonparametric approach. 

The objective of this paper is to show how to overcome the limitations of conditional location- 



scale modelling described in Sections 1.1 and 1.2 and to provide statistical tools for a new 



approach to time series modelling. Not surprisingly, those tools are essentially related to copulas, 
quantiles and ranks. The traditional nonparametric techniques, such as spectral analysis (in its 
usual L2-form), which only account for second-order serial features, cannot handle such objects, 
and we therefore propose and develop an original, flexible and fully nonparametric Li-spectral 
analysis method. 

While classical spectral densities are obtained as Fourier transforms of classical covariance 
functions, we rather define spectral density kernels, associated with covariance kernels of the 
form 

7fc(xi,X2) := Cov{I{Yt < xi},I{Yt-k < X2}) (1.2) 
(Laplace cross-covariance kernels) or 

7k{Ti,T2) := Cov{I{Ut < n},I{Ut-k < T2}) (1.3) 

(copula cross-covariance kernels), where Ut := FyIYi) and Fy denotes the marginal distribu- 
tion of the strictly stationary process {Yt}tez- Contrary to covariance functions, the kernels 
{'7k{xi,X2)\xi,X2 G M} and {7^(ri, r2)|ri, r2 £ [0,1]} allow for a complete description of arbi- 
trary bivariate distributions for the couples (Yt, lt_fc) and arbitrary bivariate copulas of the pairs 
{Ut, Ut-k), respectively, and thus escape the conditional location-scale paradigm discussed in Sec- 
tion [LTJ They are able to account for sophisticated dependence features that covariance-based 
methods are unable to detect, such as time-irreversibility, tail dependence, varying conditional 
skewness or kurtosis, etc. And, in view of the desired separation between marginal and serial 



features expressed in Section 1.2 special virtues, such as invariance/equi variance (with respect 



to continuous order-preserving marginal transformations), can be expected from the copula co- 



variance kernels defined in (1.3) 



Classical nonparametric spectral-based inference methods have proven quite effective Granger 



1964 Bloomfield, 19761, essentially in a Gaussian context, where dependencies are fully char- 



acterized by autocovariance functions. Therefore, it can be anticipated that similar methods, 
based on estimated versions of Laplace or copula spectral kernels (associated with Laplace and 
copula covariance kernels, respectively) would be quite useful in the study of series exhibiting 
those features that classical covariance-related spectra cannot account for. 

Estimation of Laplace and copula spectral kernels, however, requires a substitute for the ordi- 
nary periodogram concept considered in the classical approach. We therefore introduce Laplace 
and copula periodogram kernels. While ordinary periodograms are defined via least squares 
regression of the observations on the sines and cosines of the harmonic basis, our periodogram 



kernels are obtained via quantile regression in the Koenker and Bassett [1978 sense. A study 
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of their asymptotic properties shows that, just as ordinary periodograms, they produce asymp- 
totically unbiased estimates (more precisely, the mean of their asymptotic distribution is 27r 
times the corresponding spectrum) , and we therefore also consider smoothed versions that yield 
consistency. Asymptotic results show that copula periodograms, as anticipated, are preferable 
to the Laplace ones, as their asymptotic behavior only depends on the bivariate copulas of the 
pairs {Ut,Ut-k), not on the (in general unknown) marginal distribution Fy of the Yj's. 

Unfortunately, copula periodogram kernels are not statistics, since their definition involves 
the transformation of Yt into Ut, hence the knowledge of the marginal distribution function Fy- 
We therefore introduce a third periodogram kernel, based on the empirical version of Fy, that 
is, on the ranks of the random variables li, . . . , Y^, and establish, under mild assumptions, the 
asymptotic equivalence of that rank-based Laplace periodogram with the copula one. Smoothed 
rank-based Laplace periodogram kernels, accordingly, seem to be the adequate tools in this con- 
text. We conclude with a brief numerical illustration - simulations and an empirical application 
- of their potential use in practical problems. 



1.4 Review of related literature 



Quantities of the form (1.2) and (1.3) arise naturally when the clipped series (/{It < a;})tg^ 
and {I{Ut < T})t(=z are investigated. Processes of this type have been considered earlier in the 
literature (see, for instance, Kedem 1980] ). In the field of signal processing the idea to replace 
the quadratic by other loss functions has been discussed by Katkovnik [1998J w ho proposed to 
use Lp-distances and analyzed the properties of these M-periodograms. Hong 2000 used the 
Laplace covariances corresponding to positive lags to construct a test for serial dependence. 
Linton and Whang [2007 considered sequences of Laplace cross-correlations 7fc(T, t)/7o(t, r) 



(called quantilogmm by these authors) in order to test for directional predictability. Li [2008] 
suggested least absolute deviation estimators in a harmonic regression model assuming that the 
median of the random variables Yt vanishes. The focus of this author was on the quantity 



/o,o(^) 



fcez 



which he called Laplace spectrum. He constructed an asymptotically unbiased estimator for 
a quantity which differs from /o,o(wj) by a factor involving l/(Fy(0))^ (here uij denotes the 
jth Fourier frequency) and extended these results to arbitrary quantiles (see Li 2011| ). An 
important drawback of this method consists in the fact that it requires estimates of the quantity 
Fy(0) in order to obtain an estimate of the Laplace spectrum. Moreover, Li] |2008l |20111 does 



Hagemann 



2011 



not prove consistency of a smoothed version of his estimates. Very recently, 
proposed an alternative method to estimate the Laplace spectrum (called quantile spectrum 
by this author), which is based on an estimate of a linearization of [Li] [2008| 's statistic. This 



approach does not suffer from the drawbacks of Li 12008 's method and yields consistent estimates 



avoiding estimation of the marginal density. On the other hand this method does not allow a 
direct interpretation in terms of (weighted) absolute deviation estimates. 



In order to obtain a complete description of the two-dimensional distributions at lag k, Hong 



1999 introduced the generalized spectrum deRned as the covariance Cov(e^^i^% 6'^^^*+'=), and this 



approach was used by Chung and Hong 20071 to test for directional pedictability. Recently, Lee 



and Rao [201 1| considered a Fourier transform of the differences between the joint density of the 
pairs (Yt,yf_fc) and the product of the two marginal densities to investigate serial dependence. 
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Unlike ours, these methods are not invariant with respect to transformations of the marginal 
distributions. 

Finally, there exist some recent proposals to use pair-copula constructions to describe de- 
pendencies in the time-domain. Domma et al. 2009 assumed a first-order Markov process, such 



that only distributions of pairs {Yt,Yt-^-i) at lag k = 1 need to be considered. Smith et al. [2010 



decomposed the distribution at a point in time, conditional upon the past, into the product of 



a sequence of bivariate copula densities and the marginal density, known as D-vine by [Bedford 
and Cookel |2002| 



The approach presented in this paper differs from these references in many important aspects. 
Essentially, it combines their attractive features while avoiding some of their drawbacks. It 
shares the quantile-based flavor of Kedem [1980 , Linton and Whang [2007 , Li [2008 , 2011| and 
Hagemann [2011 . In contrast to the latter, however, we do not focus on a particular quantile, 
and consider copula cross-covariances 7^(ri,r2) for all (not necessarily equal) values of ti,T2, 
while Li 2008, 2011| and Hagemann |2011| restrict to the case ti = T2. As a consequence, we 
obtain, as in the characteristic function approach of Hong [1999 , a complete characterization of 
the dependencies among the pairs {Yt,Yt_i:). This allows to address such important features as 
time reversibility [see Proposition |2.1[ or tail dependence in general. By replacing the original 



observations with their ranks, we furthermore achieve an attractive invariance property with 



respect to modifications of marginal distributions, which is not satisfied in the case of Hong 



[1999] 's method. Moreover, we also avoid the scaling problem of Li's estimates and establish the 
consistency of a smoothed version of periodograms. Finally, because our method is related to 
the concept of copulas it allows to separate marginal and serial aspects of a time series, which 
makes it attractive for practitioners. 



1.5 Outline of the paper. 



The paper is organized as follows. In Section 2.1, we introduce the concepts of Laplace and 
copula cross-covariance kernels which, in this quantile-based approach, are to replace the ordi- 
nary autocovariance function. The corresponding spectra and periodograms are introduced in 
Sections 2^ and 2^, respectively. Section [3] deals with the asymptotic properties of the Laplace, 
copula, and rank-based Laplace periodograms. In Section |4| smoothed periodograms are con- 
sidered, and the smoothed rank-based Laplace periodogram kernel is shown to be a consistent 
estimator of the copula spectral density. Some numerical illustration is provided in Section [5} 
and most of the technical details are concentrated in an appendix. 



2 An Li-approach to spectral analysis. 

2.1 The Laplace and copula cross-covariance kernels. 

Covariances clearly are not sufficient for describing a serial copula. We therefore introduce the 
following concept, which will be convenient for that purpose. Let {Yt}tez be a strictly stationary 
process and define the copula cross-covariance kernel of lag A; € Z of {Yt}te'z as 



7.^ 



{l^{n,n) I (ri,r2)G (0,1)2} 
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where 7^(ri,r2) is defined in (1.3). Similarly, define the Laplace cross- covariance kernel of lag 
A: E Z of {yjtez as 



Ik ■■= [lk{xi,X2) I (X1,X2) G M^j, 



where 7fc(xi, 2:2) is defined in ( 1.2 ). Contrary to traditional cross-covariances, copula and Laplace 
cross-covariance kernels exist for all k (no finite variance assumption needed). The words "co- 
variance" and "cross-covariance" are used out of time series classical terminology; but we only 
consider covariances of indicators, which provide a canonical description of their joint distri- 
butions. The copula cross-covariance kernel of order k indeed entirely characterizes the joint 
distribution of {Ut, Ut-k)-, and conversely, without requiring any information on the distribution 
function Fy of Yj. Along with Fy, the copula cross-covariance kernel of order k entirely char- 
acterizes the Laplace cross-covariance kernel of order k and the joint distribution of (yj,lt_fc), 
and conversely. If / x'^dFy < 00, the distribution function Fy of Yt and the collection of copula 
cross-covariance kernels of all orders jointly characterize the autocovariance function of {Yt}tez- 

2.2 The Laplace and copula spectral density kernels. 

Assume that the Laplace cross-covariance kernels 7^ (equivalently, the copula cross-covariance 
kernels 7^), A; G Z are absolutely summable, that is, they satisfy X]fcL-ool')''<:(^i' ^2)! < 00 for 
all {xi,X2) G M^. Then, 7^ admits the representation 

Akco 



7k{xi,X2)= e' '^f^i,i.2(a;)dcj, (xi,X2)G 



with 



^ 00 

fx„x,{u}) = — J2 ^k{xi,X2)e-'^'^, {xi,X2)eR\ (2.1) 



fc=— 00 



The collection {u 1— )• fxi,x2i^)\{xi, X2) G K^}, called the Laplace spectral density kernel, is such 
that each mapping uj G (— 7r,7r] 1— fj,j^^2(a;), (xi,X2) G M^, is continuous and satisfies (writing z 
for the complex conjugate of z G C) 



fxux2 (-^) = fx2,xi (w) = fa;i,x2 (w)- (2.2) 
Similarly define the copula spectral density kernel as 

f«n-...H = ^ 5^ 7.''(n,T2)e-^-, (n,r2)G (0,1)2. (2.3) 

A;=— 00 

where ■= Fy^iri) {i = 1,2). Note that fq^^^q^^ is the Fourier transform of the differences 
between copulas of the pairs (1^, lt_A:) and the independence copula. Clearly, the same identity 



(2.2) holds for fg^^.g^^^^) fxi.Xii^^) 



Throughout this paper we denote by = equality in distribution and define and ^z as the 
imaginary and real part of 2; G C, respectively. Obviously we have Qfxi,x2{^) = for all uj if 
and only if 7fc(xi,X2) = 7-A;(a;i,X2) for all k and we obtain the following result. 
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Proposition 2.1 The following statements are equivalent: 

(1) {Yt,Yt+k) = iYt,yt-k) for aU k (time-reversibility). 

(2) Qfxi,x2{^) = for all oj and xi,X2 ■ 

(3) Q'fg.j.g.j i^) = foi' all and n, r2 . 

2.3 The Laplace, copula, and rank-based Laplace periodogram kernels. 

The Laplace (resp., the copula) cross-covariance kernels describe the behaviour of Yf (resp., 
of Ut = FyiYt)) via a characterization of their conditional quantiles. 

If a quantile-based approach is to be considered, it seems intuitively reasonable that the tradi- 
tional L2-tools, which are closely related with the concepts of mean and variance, be abandoned 
in favor of quantile-specific ones. In particular, traditional L2-projections should be replaced 
with (weighted) Li-ones. Recall that, in traditional spectral analysis, estimation is usually based 
on the ordinary periodogram 

1 I " 2 

where ujj^n = 27rj/n G := {2Trj/n\ j = ^, • • • , L^^J i L^J } denote the positive Fourier 
frequencies. A straightforward calculation shows that this can be expressed as 

In{^j,n) = ^||b„,oLs(Wj,n)|P := -^^'n^Q-Lsi.^ j,n) ^ ■ b„_oLS ("^j.n) , 

where 

n 

(a„,oLs(wi, „), b'„^oLs(^j,n)) := Argmin(^_b')eM3 ^ {Yt - (a, h')ct{ujj^n)) (2.4) 

t=i 

is the ordinary least squares estimator in the linear model with regression constants Ct{ojj^n) '■= 
{l,cos{tujj^n),sm{tujj^n)y , Corresponding to an L2-pi"ojection of the observed series onto the har- 
monic basis. 

If, instead of a representation of Yt itself, we are interested in a representation, in terms of 
the harmonic basis, of It's quantile of order r, it may seem natural to replace that ordinary 
periodogram In{uJj,n) with 

where 

n 

(an,r(wj>),b„,^(wj,„)) := Arg mm/^ bMelR'' ^ Pt {Yt - (a, b') 

)) , (2.5) 

t=i 

and 

Pr{x) := x{t - I{x < 0}) = (1 - t)|x|/{x <0}+ t\x\I{x > 0}, re (0, 1), 

is the so-called check function (see Koenker [2005] ). In definition ( |2.5| ), the L2-I0SS function, 
which yields the classical definition (2.4), is thus replaced by Koenker and Bassett's weighted 
Li-loss which produces quantile regression estimates jKoenker and Bassett [1978] . That this 
indeed is a sensible definition will follow from the asymptotic results of Section [3| 
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This Li-approach has been taken by Li 2008 for the particular case r = 1/2 , leading to a 
least absolute deviations (LAD) regression coefficient b„^o.5 and later by Li 2011 for arbitrary 
TG (0,1). 

More generally, for a given series Yi, . . . ,Yn, define the Laplace periodogram kernel as the 
collection 



Ln,Ti,T2{^j,n) '■— ^t»^,Ti('^i,n) 



i 1 



,T2 V-^jyTl ), (ri,r2) G (0,1)^ G Fn. 



(2.6) 



For any (ri, r2, a;j,„), computation of Ln,Ti,T2{^j,n) is immediate via the simplex algorithm (as 
in classical Koenker-Bassett quantile regression, see |Koenker|[2005l ). 



Similarly, define the copula periodogram kernel as the Laplace periodogram kernel L„ .^^ .^.^ ('^j,™) 



This means that 1/^,-^ ^^{ojj^n) is obtained from (2.6) by 



associated with the series C/i , . . . , C/, 
replacing the estimate b„ ^ by the second and third component of the vector 



(a, (b^)') := Argmin(„ b,)g]g3 ^ {Ut - (a, b')ct(a;j- „)) 



Finally, because the marginal distribution function Fy required for the calculation of the data 
Ut = -Fy(yj) is not known, we introduce the empirical or rank-based Laplace periodogram kernel 



1 E>(") 



as the Laplace periodogram kernel L„,Ti,r2 {^j,n) associated with the series n Rl 



where r["'^ denotes the rank of Yt among Yi, 



,Yn. In other words, Ln^Ti,T2{'^j,n) is obtained 



from (2.6) by replacing the estimate b^^r by the second and third component of the vector 

n 

.-1 



(a, b' ) := Argmin(„_b')eR3 ^ Pr 



n-'Rl 



(a,b')ct(a;j>) 



t=i 



Before we continue, a few remarks regarding the philosophy of the notations used in this paper 
might be appropriate. With T we usually denote a statistic obtained from the original time 
series Yi, . . . , 1^ such as Ln,Ti,T2- The notation means the T has been calculated from the 
"data" C/i, ...,[/„- a typical example is -L^^^ ^-2 (note that Ut = Fy(lt)). Finally, the notation 

T reflects the fact that T has been calculated from the normalized ranks n~^R^\ . . . , n'^R^"^ 



such as the rank-based Laplace periodogram kernel L„. 



,n,T2 • 



3 Asymptotic properties. 

3.1 Asymptotics of Laplace and copula periodogram kernels. 

We now proceed to deriving the asymptotic distributions of the Laplace and rank-based Laplace 
periodogram kernels, which, as we shall see, establishes their relation to the spectral density 



kernels defined in (2.1 ) and (2.3). Throughout the rest of the paper we make the following basic 
assumptions. 



Assumption (Al) The process {Yt}tez is strictly stationary and nin- decomposable Chanda 
i.e. it admits a representation 



et al. 1990 



Yt — Xt^n + F)t,m i G 



n G 



(3.1) 
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where {Xt^n} and {-Dt,n} are strictly stationary and {Xt^n} is mn-dependent with m„ = 0{n^^^ 
for some a > and, for some nonnegative sequences (?/„) and converging to as n — )• oo, 

P(| A,n| > Vn) < Kn. (3.2) 

Assumption (A2) The distribution function -Fn,x of Xt^n and, for any ti, t2, the joint 
distribution functions of Xt^^n) are twice continuously differentiable, with uniformly (with 

respect to n and all their arguments) bounded derivatives. Moreover we assume that there 
exist d > and no < oo such that 

inf inf fn,x{x) > 0, 

n>no \x-q„,^\<d 

where fn,x and qn,T '■= P'nxi'^) denote the density and r-quantile corresponding to the distri- 
bution Fn^x- 

Assumption (A3) For any r G (0, 1), 

n 

sup ^ |Cov(/{Xi,„ < qn,T},I{Xk,n < gn,r})| < OO. 
k=—n 

Assumption (A4) |/„,x(gn,r) - /y(gr)| = o((logn)-i). 

Let Qr := -Fy^(r) denote the r-quantile of Fy and consider a z^-tuple Q := {ui, . . . ,lOu} C 
(0,7r) of distinct frequencies. Denote by Ln^Ti,T2 and L^^^^^j respectively, the Laplace and 
copula periodogram kernels associated with a realization of length n. For each {ti,T2) S (0, 1)^ 
and Lo G (0,7r), write 

l„r, H ■■= Ur„,r.S^)/Uy{qr,)fY{qr,)) (3.3) 

for the scaled version of the spectral density kernel fg^^.g^.^ {'^) defined in (2.3). In the following 

two statements denotes convergence in distribution, and denotes a chi-square distribution 
with k degrees of freedom. We also introduce the piecewise constant function (defined on the 
interval (0, vr)) 

gn{oj) := UJj^n, (3.4) 

where ujj^n is the Fourier frequency closest to uj such that oj G (wj^^ — ujj^n + ^]- The following 
result is the key for understanding the asymptotic properties of the Laplace periodogram kernel. 

Theorem 3.1 Let Q := {ui, . . . , LOp} C (0, vr) denote distinct frequencies and T := {ri, . . . , Tp} C 
(0, 1) distinct quantile orders. Let Assumptions (A1)-(A4) be satisfied with (A2) and (A3) hold- 
ing for every r G T. Also assume k„ -|- = o{n~^). Then 



rST, cjer2 n-s>oo \ / tST, ajef2 

where {Nt-{uj))t-i^t,uj(^q. denotes a vector of centered normal distributed random variables with 



2tt 



Kf.,,., (^) 



»fr,,r. (^) 



'0 0^ 
,0 0, 




(3.5) 
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Proof. The proof consists of two basic steps which will be sketched in this section. The technical 
details for the arguments presented here can be found in Appendix A. 



Step 1: The first step consists of a linearization of the estimate hn,T{^j,n) defined in (2.5). 
To be precise we define for any r G (0, 1), w S (0, vr) and 5 € M'^ the functions 



Zn,T,w{S) ■■= ^ {PriYt - Qt 



n 



t=l 

n 



Zn,T,u{^) ■= ^{priXt^n- qn,T -n ^/^c't{uj)S) - Pr{Xt,n- qn,T)), 



(3.6) 



(3.7) 



t=i 



where Cf(a;) := (1, cos(a;t), sin(a;t))', and qr and qn^r denote the r-quantiles of Fy and Fn^x, 
respectively. Further define 



where 



We first show that the minimizers 



n 



-1/2 



^Ci(a;)(r - I{Xt^n < ^n.r}) 



t=l 



fn,x{qn,T)n ^^ct(w)cj(cj). 



t=l 



Sn,T,Lo ■■= argmin Zn,r,uj{^) and d := argminZ„ (d) = (Q„,^,^) Cn,r,^ 

O O 



(3.8) 
(3.9) 

(3.10) 



are close in probability (uniformly with respect to a; G J~n)- Note that from the definition 



in (2.5) it follows that the random variable ^/nhn,T{^j,n) coincides with the second and third 
component of the vector dn,T,uj- Moreover, for ujj^n = 27rj/n we have 

Qn,r,u,,„ = fn,x{qn,r) diag(l, 1/2, 1/2), (3.11) 

where diag(ai, . . . , a^) denotes the diagonal matrix with diagonal elements oi, . . . , a^. 
More precisely, we establish the following estimate 

sup ||<5„,,,^ - S^^rJ = op((n-i/8 V (n-i/6my3))(iogn)3/2). (3.12) 

This result is obtained from the following arguments, for which the details are provided in 
Section 6.1 Roughly speaking, estimates of the type (3.12 ) can be obtained by showing that the 
corresponding functions Zn,T,u} and Z^^^^ are uniformly close in probability. A precise statement 
is given in Lemma 6.1 (see Section [6.1.1 ), where we show that ( |3.12 ) follows if the estimate 

sup sup |Z„,,,,(5)-Z;^,^^((5)| =op((n-i/4v(n-i/V2/3))(logn)3) (3.13) 
can be proved for some e > 0. In order to prove this estimate we show in Section [6. 1 . 2| that 



sup 



sup \Zn,rAS) - Z^,r,JS)\ = op{{n-'/^ V {n-'/^ml/')){lognf), (3.14) 



'1/3^2/3n 
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where the function Z^^^^^ is defined in (3.7). It remains to prove that the functions Z^^^^^ and 
^nrui ^''^^ uniformly close in probability, which is done in two steps. First we apply Lemma 6.2 
(see Section 6.1.1), which yields that there exists a finite constant A such that, with probability 
tending to one. 



sup sup |^n,r,a;('5) - ^n,r,a;(^)l < SUp SUp I ^n,r,a; ('5) " ^n,r,^ ('5) | • 



Secondly, we show in Section 6.1.3 that this result entails 

sup sup \Zl,^^{6) - Zl,^^{6)\ = op((n-i/4 V {n~^l^m^J^)){\ognf). (3.15) 



Combining the estimates (3.14) and (3.15) yields (3.13) and as a consequence (by an application 
of Lemma 6.1) we obtain the estimate (3.12). 

Step 2: As we have discussed at the beginning of the first step, the asymptotic properties 
of y/nhn,T{^j,n) can be obtained from those of the random variables S^^^ for which an explicit 
expression is available. More precisely, for given sets O := {uji, . . . ,uju} C (0,7r) of Fourier 
frequencies and T := {ri,...,rp} C (0,1) consider the linear combination with coefficients 
Ajfe G R^, i = 1, . . . , I/, /c = 1, . . . ,p 



p u 



Vt„(c<Jj) 



k=l 1=1 



n 



{Tk - I{Xt,n < Q'n.Tfe}) + Op(l) 



k=l ■'^WrJ .^^ 



n 



■{Tk - I{Xt,n < qn,Tk}) + Op(l), 



(3.16) 



where Ytn{uj) := {cos{gn{(^)t) , sm{gn{oj)t)y . The first equality is a consequence of (3.10), ( |3.11 ) 
and ( 3.12[ ). For the second one, observe that the sum with respect to t, that is 



n , . 

Siz, k) := "^{Tk - I{Xt,n < 5n,.J) 



t=l 



(3.17) 



converges in distribution for every k G {1, ...,p},i G {1, z^} as we will show below. This implies 
that each of those sums is stochastically bounded, and together with assumption (A4) this yields 
the second equality. To prove the convergence in distribution, note that the summands in the 
sum with index t in the last line are uniformly bounded and form a triangular array of centered, 
mn-dependent random vectors. For the covariance we obtain 



^ n n 

= - ^tlA^hWt2,ni^i2) Cov(/{Xti,„ < qr^^,n}J{Xt.,,n < ^rfe^.n}) 

tl=lt2 = l 
^71 n 

= -Yl 5Z^*l'"(^^l)^*2.«(^*2)^°^(^'L^*l - 9^fei}'-^{^<2 ^ 9rfcJ) +o(l), 



^1=1*2 = 1 



11 



where the last equahty is due to the fact that 

ti = lt2 = l 

-CoviI{Yt,<qr,J,I{Yt,<q,^ji 

^ n n 

ti=li2=l 

+ E\nYt„n < qr,JI{Xt„n < qn,r,J " I{Yt, < qr,JI{Yt, < qr,j\ 

^ n n 

-~YY1 - 1n,r,J < \Dt,,n\ + \qn,rk, " ^r^j) 



ti = lt2 = l 



+ F{\Xt2,n - qn,Tk^ I < \Dt2,n\ + kn, 



and the assumption that k„ + 7/„ = o(n ^). Along the same lines as in the Proof of Theorem 2 
of Li [2008j , we then obtain 

, 4 " " Cov(J{y,,<g.,J,J{y,,<,.,J) 



tl =1*2 = 1 



fY{qT^^)fY{q 



where M{Tk^,Tk^) is defined in (3.5). By a Central Limit Theorem for triangular arrays of m„- 
dependent random variables (Lemma 6.6), this proves the weak convergence of the sum S{k,i) 
defined in (3.17). Next, apply Lemma 6.6 to the first term in the last line of (3.16) to obtain 

P r, n / N p u 

E E^^^ E "^(-^ - ^ ^ AA(o, Var(^ ^ A:,iV.,(a;.))), 

where (-/Vt-('^))tgt, wen denotes a vector of centered normal distributed random variables with 
Cov(A^T-^(a;i), A^T-2('^2)) = -^('^fci! ^^2) defined in (3.5). Because of (3.16), the quantity 

p V 



k=l 1=1 

converges to the same limit distribution. Thus it follows by an application of the traditional 
Cramer- Wold device that 



> [Nriu;) 



□ 



As an immediate consequence of the above result the Continuous Mapping Theorem yields 
the asymptotic distribution of a collection of Laplace periodogram kernels. 



(3.18) 



Theorem 3.2 Under the assumptions of Theorem \3.1\ 

(5n(wi)), . . . , {9n{uJu))) > (-Lri,T2(wi), . . . ,-L^i,r2(^i.)), 
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where the random variables iri,r2 associated with distinct frequencies are mutually independent. 
Moreover, 

and 



,(a;) ~ TT f {uj)xl if n = rs, 



(3.19) 



-^ri,T2('^) — ^12) 



1 -i 
i 1 



Z21 
Z22 



if n / T2, 



where {Zn, Z12, Z21, Z22y ~ A/'(0, E4(cj)) with covariance matrix 



2tt 



frin (^) 




rir2 i^) ^fTir2 ('-^) 



3fifrir2 (^) '3fnr2 (^) fn 









o 

fnr2 C'^) / 



(3.20) 



It follows from Theorem 3.2 that, for all {ti,T2) G (0, 1)^ and co G (0,7r), 

E[L,„,,(u;)] =27r f,^,,^ (a;), 



which indicates that an estimator of the scaled spectral density 27r fT-i,T2 i^) defined in (3.3) 
could be based on an average of quantities of the form Ln^ri,T2i^)- Moreover, the following 
result is an immediate consequence of Theorem 3.2 and yields the asymptotic distribution of the 
copula periodogram kernel. 

Corollary 3.1 Let $7 := {coi, . . . ,uju} C (0,7r) denote distinct frequencies and {ti,T2) S (0, 1)^. 
If Assumptions (A1)-(A4) hold for every r S {ti,T2}, with K,n + fln = o{n~^), then 



' n,ri ,r2 ^ 



T1,T2 ^ 



,^H.„(a;,)), 



T1,T2 ' 



(3.21) 



(5n(wi)), • ■ 

where gn{^) is defined in (3.4). The random variables L^-^^^^ in (3.24) associated with distinct 
frequencies are mutually independent, 



L 



u 



{uj) ~ vrf, g (a;)x2 if n = T2, 



(3.22) 



L^^,,^(a;)^^(Zn,Zi2) 



1 -i 
i 1 



Z21 
Z22 



if Tl / T2, 



and {Zii, Zi2t Z21, Z22)' ~ A/'(0, E4(tj)) with covariance matrix 



^4(0;) := 27r 








^U.,qr,{^) 


~^fgrigr2 ("^ 





f'?rigT2('^) 


"^Ur^qr^i^) 


'^U.^q.M 






Ur.qr^i^) 







Kf,.,,.,(^) 








(3.23) 



In particular. 



27rfgxi,g.2(^)- 



This means that copula periodogram kernels L^t-^ j.^, rather than the Laplace ones Ln^ri,T2^ thus 
seem to be the appropriate tools for statistical analysis regarding f^^^ ^q^^ . Unfortunately, they 
are not statistics, since they involve the unknown marginal distribution Fy which in practice is 
unspecified. This problem will be solved in the following section. 
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3.2 Asymptotics of rank-based Laplace periodogram kernels. 

The final result of this section establishes the asymptotic equivalence of the copula and rank- 
based Laplace periodogram kernels Ul^^^^^{u}) and Ln^TiT2{'^)^ where the latter do not involve Fy 

and can be computed from the data. In particular the following results show that b „^ i^n,Ti,T2 i^) 
are asymptotically distribution-free in the sense that their asymptotic distributions only depend 
on the process {Ut}t£'z- 

Theorem 3.3 Let il. := {coi, . . . , cou} C (0, vr) denote distinct frequencies and T := {ri, . . . , Tp} C 
(0, 1) distinct quantile orders. Let Assumptions (A1)-(A3) be satisfied with (A2) and (A3) hold- 
ing for every r G T. Also assume Kn + rjn = o{n^^). Then 



bn,r(5'n(^^)) 



cov«,^,<,j = <; 



where {Nl/^)T-^T,ujen denotes a vector of centered normal distributed random variables with 

if oji = UJ2 =■ w, and 
if wi 7^ i02- 

Together with the above result, the Continuous Mapping Theorem yields 



0' 
,0 0, 



Theorem 3.4 Under the assumptions of Theorem 3.2 

{gn{uJi)), . . . , Ln,Ti,T2{9n{oOu))) — > {L^^ -,^{u}i) , . . . , L^^^^^{u;,y)) , (3.24) 
where gn{^) o-nd the distribution of the random variables are defined in (|3.4|) and Corollary 



3.1. respectively. 



Proof of Theorem 



3.3 



Let Fny denote the empirical distribution function of Yi , . . . , 1^ 



ei := (1,0,0)', 6 = {5i,52,6^)', and Ut. ^x{Xt^n)- We introduce the functions 

n 

Zn,rAS) := J2iP-(^n,Y{Yt)-T-n~'/^c[{u)d)-priFn,Y{Yt)-T)) 

t=l 
n 

{pr{Fn,Y{Xt,n) " T - n-'/^c[{oj)S) - Pr{Fn,Y {Xt,n) " t)) 



t=l 



t,n-T -n 



t=l 



-'/^C[{U)S) - Pr{Ut,n - t)) - 5iV^{Fn,x{FnY{^)) " ^) 



Zl^^^{5) := -6\Ctr,. + ^'iV^{FnAFn:Y{^))-r)) + ^6'q,lJ 



where 



1 " 



U -1/2 



Y,Ctiio){r-I{Ut,n<T}). 



t=l 



t=l 
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If we can show that the difFerence t lu (S) — Zll^^{5) is uniformly small in probability, a slight 
modification of the arguments presented in the proof Theorem |3.2| yield a uniform linearization 
of 

^n,T,u) '■ — arg min^ ^^ ,-^(^((5). More precisely, we show 



sup \\Sn,T,Lj - Sn,T,J\ = op{n ^/^my^'log 



n 



(3.25) 



where 



6^,,, := argminZ^,,^(5) = (Q^,..)-' (C + ei V^(F„,x(F-^(t)) - r)) . 



The asymptotic normality of the linearization ^ then follows by similar arguments as given 
in Step (2) of the proof of Theorem 3.2 and the details are omitted for the sake of brevity. 



In order to prove (3.25) we note that Lemma 6.1 in the Appendix also holds with Zn^r,uj{S), 
^n,T,iui^)^ ^n,T,ui and dn,r,u replaced byZ„_^,(^((5), 5^,^,^ and 'dn.,r,w, respectively. There- 

fore, it suffices to establish that, for some e > 0, 

sup sup ||„,,,,(<5)-Z^,,^(5)| =op(n-i/^my2(logn)2). (3.26) 



Note that (5^,-^^ decomposes into a term containing Cn,T,aj' which Lemma 6.2 applies, and 
a term involving y/n{Fn,x{FnY{'T)) — t), which, for every r, converges in distribution, so that 
- r) > A^Jlogn) for any ^4 > 0. Therefore, there exists a finite 

constant A such that 

lim P( sup ll^^^^lloo > A^Jlog n) = 0. 



It follows that, in order to establish (3.26), we may restrict to a supremum with respect to the 
set ll^ll < 2^-^log n. Knight's identity (Knight 1998 ; see p. 121 of Koenker 2005 ) yields 

where 

n 

Zlr,.AS) = -5'n-V2^c,(u;)(r-/{t/,„<F„,x(F„-^(r))}), 

t=i 

in,r,.,2i^) = E / (^{^*." ^ ^n,^(^n + ^))} " HUt,n < (^"^ (r)) }) ds. 

A similar representation holds for Z^^^(6). Now the proof of (3.26) is a consequence of the 
following three auxiliary results, which are proved in Sections |6.2.1[|672.3[ 

sup sup \Zn,T,ujiS) - Z^^^^^{S) \ = Op((k„ + r]n + r„(2r/„,m„))i/nlogn) (3.27) 

i^e^n ||(5||</lv'Iogn 



where rn{2r]n,mn)) = o((n logn) ^/^) (for a precise definition see equation 6.8 in Appendix B), 

n 

Zlr,.,i{S) - ^*(^)(^ - ^ ^» (3.28) 

t=i 

- 5,MFn,x{Fn'Y{r)) - r)| = Op{n-^''m]/\\ognfl^). 



sup sup 

i^eJ'n ||5j|<Av^Iogn 
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sup sup 

'^eJ'n ||(5||<AVIe5gn 



t=l Jo 



n-l/2cj{a;)5 



{l{Ut,n<S + T]-I{Ut,n<r])As 

= Op(n-i/^my2(logn)3/2 + y^nlogn(K„ + r/„ + r„(r?„, m„))) . (3.29) 
Note that the combination of ( |3.28| ) and (3.29) imphes that ^^^- ^^ and Z^^^^^ are uniformly close 



in probability. Finally, we obtain from (3.15) 

sup sup \Zl,,^{6) - = Op((n-V4 V „-l/3^2/3)(i^g^)3)^ 



(3.30) 



where we may replace Z^^^^^{5) with Z^^^^^^^iS) and Z^.j.^^{5) with Z^^j^(5), since C/i,rn • • • , C^n,n 
are m„-dependent as required and the additional term 5l^/n{Fn,x{FnY{T)) — t) appears in 
both Z\l^^^{8) and Zll^^{5). Combining ( 3.27 )-( 3.30) yields (3.26), thus completing the proof 
of Theorem [Q ' ' □ 



4 Smoothed periodograms. 



We have seen in Section 3.1 that the Laplace periodogram kernel converges in distribution and 
that the expectation of the limit is the scaled spectral density kernel (at (Ti,r2)) 



2vr I,,,, (u;) := 2vr ^'^j'"^ = ^ 7fc(9n > ^rje'-'^ 



In practice, however, this is not enough, and consistent estimation is a minimal requirement. 
For this purpose, we consider, as in traditional spectral estimation, smoothed versions of peri- 
odograms, of the form 

) (4.1) 

\k\<Nr, 

at the Fourier frequencies uj^n = 27rj7n, where A''„ — )• oo as n — )• oo is a sequence of positive 
integers, and Wn = {Wn{j) ■ \j\ < Nn} a sequence of positive weights satisfying 

Wn{k) = Wn{-k) for all k and ^ Wn{k) = 1. 

\k\<N„ 

Extending the definition of fn,ri,T2 to the interval (0,7r) we introduce 

(u) I {n,T2) G [0,1]2, oj G (0,7r)} 
as smoothed Laplace periodogram kernel, where 

fn,ri,r2(w) := f„,^,,^2 (5„(u;)) , (4.2) 



and the function gn{oo) is defined in (3.4). In order to show that fn,Ti,r2('^) is a consistent 
estimator of the scaled spectral density f^^ i!^) make the following additional assumptions. 
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Assumption (A5) Nn/n 0, and ^ W^ik) = 0{l/n) as n oo; 

\k\<N„ 

Assumption (A6) For any ri,T2,T3,T4 G (0, 1), Efcl-oo l7fc(n,T2)| < oo, and 

oo 

^ I cmn{I{Yt < QtA, HYt+k2 < ^ra}, ^{^t+fca < QT3},I{Yt+k4 < 9r4})| < oo; 

k2,k3,k4=—oo 



Assumption (A7) The function fq^^^q^^ defined in (2.3) is continuously differentiable for all 
(n,r2) G (0,1)2; 

Theorem 4.1 Let (Al)-(A7) hold, with rjn = 0{l/n) and k„ = 0(l/n). Then the smoothed 
Laplace periodogram defined in (4.1) and (4.2) is a consistent estimator for the scaled Laplace 
spectral density; more precisely, 

krur^i^) = 2tt t,,,, (io) + Op{Rn + 71'^/^ + Njn) = 2tt {^) + op(l), (4.3) 
where Rn = Ifrigr) - fn,x {qT,n)\ log n + (n^^/® V n-^/^ml/'^){lognf . 

Proof. The proof proceeds in several steps which are sketched here. The technical details can 
be found in the Appendix B. We first show (Section 7.1) that 

(Ujj^n) = Ln,ri,T2(Wj>)/(/y(gri)/y(gT2)) + Op(^n), (4.4) 

uniformly in the Fourier frequencies Uj^n ■= 2'7rj'/?7-, where 

Ln,Ti,T2{^j,n) ■= 'n~^dn{Tl,idj^n)dn{T2, —UJj^n), 

dn{T,ujj,n) := Er=ie'"^'"*(^ - HYt < qA) = (1, i)'ni/2b„,,,^^. „2-i/y (^r) and 

As an immediate consequence we obtain 

fn,ri ,T2 )/(/y(9n)/y(g.2))+Op(^n)- 

\k\<N„ 



In Section 7.2 we show that, for any = 27rj/n, 

Ln,Ti,T2 {^j+k,n) 



\k\<N„ 



T2) 



f,^,,, (t^,+M) =Op(l/V^). (4.5) 



Now, let ojj^n be a sequence of Fourier frequencies that converges to a frequency oj G (0, vr) with 

o o 

rate \ujj„n — uj\ = 0{Nn/n): both for / = K f^^ and / = 9 f^^ have 



„+k,n)\ \^j„+k,n — ^\ 

\k\<N„ \k\<N„ 

<Cn Y Wn{k)\2Trk/n + ojj,^n-oj\<Cn Y ^n(fc) |27rfc/n| + C„ Y Wn{k)\ujj^r. 



■ UJ\ 



\k\<N„ 



\<N„ 



\k\<N„ 



<Cn{2TTNn/n+\ I) Y Wn{k) = 0{Nn/n), 
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where \S,j„+k,n - uj\ < \u - ujj„+k,n\ and C„ := sup^g=^ I/' (01 is the supremum over 



— [i 



UJ — UJ — U}. 



Note that, since \uj — ^^j„,n\ — ^ and 0JN„,n = 2T:Nn/n 0, Cn ^ f'i^)i so that (C„) is a 
bounded sequence. This yields 



\k\<Nr, 



0(iVn/n) 



and completes the proof of Theorem 4.1 



□ 



For a consistent estimation of the (unsealed) Laplace spectral density fri,T2{^), we propose 
a smoothed version 

\k\<Nn 

of the rank-based Laplace periodogram Ln^Ti,T2{^)- We then have the following result 

Theorem 4.2 Let Assumptions (A1)-(A3) and (A5)-(A7) hold with rjn = 0{l/n) and Kn = 
0{l/n). Then the smoothed rank-based Laplace periodogram L^'^^ is a consistent estimator of 
the (unsealed) Laplace spectral density fq^^^q^^- More precisely, 

(a;) = 24,,^,,,^ (a;) + Op (o{n-'/^mi/^{lognf/^) + iV„/n) = 27rf,,^,,,^ (a;) + op(l). 



Proof. The proof is very similar to the proof of Theorem 4.1 The main difference lies in the 
asymptotic representation for the quantity n^/^b^^^ denoting the second and third coordinate 



of the quantity in (3.25). Here we have to estimate the difference 



An := sup 



Direct computation shows that 

n 

An < Cn-i/2^|I{Fy(yt) <r}-/{F„,x(^t,n) <r}| 
t=i 

n 

< Cn-'/^^I{\Fn,x{Xt,n)-r\ < {FyiYt) - Fn,xiXt,n)\} 

t=l 

n 

< Cn-'/^^I{\Fn,x{Xt,n)-r\ < \\Fy - Fn,x\\oo + C\Dt,n\} 

t=l 

n 

< Cn-l/2^/{|F„,x(^t,n)-r| < \\Fy - Fn,x\\oc + Cljn} + I{\Dt,n\ > Vn}- 



t=l 



Since 



\I{Yt <X}- I{Xt,n <X}\< I{\Xt^n -X\< I A,n|} < - x\ < r]n} + /{| A,n| > Vn} , 
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\\Fy - -^n,x||oo = 0{Kn + rjn). Thus, E\An\ = 0{y/n{Kn + ??n)), hence An = Op(V^(k„ + rin)). 
The rest of the proof follows by the same arguments as in the proof of Theorem |4.1[ yielding 
the estimate 



ln,ri,r2(w) = fruTii^) + Op ( logn(K„ + r/„) + 



Finally the assumptions imply ^nlogn(K„ + r/„) 



pletes the proof of Theorem 4.2 



[n 



m. 



logn)Vlogn + n + iV„/n 



n 



-1/2 



on 



(logn)^/^), which com- 



□ 



Note that Theorem 4.1 solves an open and important problem raised in Li [2008 2011 
who considered the Laplace periodogram Ln,Ti,T2 foi' = ^2- This author showed asymptotic 
unbiasedness, but did not prove consis tenc y of a smoothed version of the Laplace periodogram. 
Moreover, as pointed out in Theorem 3.1 the smoothed version of Ln,Ti,T2 is not consistent for 



the copula spectral density kernel, which is the object of interest in our paper. Theorem 4.2 
shows that the smoothed rank-based Laplace periodogram yields a consistent estimate of this 
quantity. 



5 Finite sample properties. 
5.1 Simulation results. 

In order to illustrate the finite sample properties of the new estimates we present a small sim- 
ulation study. We consider AR(1) processes Yt = ■i?li-i + £t with A/'(0, 1)- and ti-distributed 
innovations £t, where 'd := —0.3. All results presented in this section are based on 5000 simula- 
tion runs. 

We generate pseudo-random time series of lengths n = 100, n = 500 and n = 1000, of the 
AR(1) processes and calculate the Laplace and rank-based Laplace periodogram, for ti,T2 G 
{0.05,0.25,0.5,0.75,0.95}. We also determine the smoothed estimates using Daniell kernels (as 
Brockwell and Davis [2006] , Example 10.4.3), where the parameters are (2,1) for n = 100, 



m 



(10, 4) for n = 500 and (10, 25) for n = 1000. From all calculated periodograms we determine the 
mean to estimate the expectation of the various estimates. Each of the following figures contains 
9 sub figures. For any combination of ri and T2, the imaginary parts of periodograms and spectra 
are represented above the diagonal, whereas the real parts are represented below, or, for ri = T2, 
on the diagonal (note that in the case ri = T2 all quantities under consideration are real). The 
curves are plotted against uj/{27r). In all figures, the dashed line represents the "true" spectrum 
(scaled for Figures [T] and [2j unsealed for Figure |3] and |4]) and the solid line the (pointwise) 
mean of the simulated smoothed Laplace periodograms. In order to illustrate the variability 
the figures contain some additional information. The dotted lines represent the 0.1 and 0.9 
(pointwise) sample quantiles of the unsmoothed periodograms from the 5000 simulation runs, 
while the border of the gray area represents the 0.1 and 0.9 sample quantiles of the smoothed 
estimates. 

For the sake of brevity only results for sample size n = 500 are presented here, but fur- 
ther results, which show a similar behavior, are available from the authors. In Figure [T] we 
present the results of the Laplace and smoothed Laplace periodogram in the case of Gaussian 
innovations, while the case of ti-distributed innovations is shown in Figure [2| Inspection of 
these figures reveals that the imaginary component of the spectrum is vanishing in the case of 
Gaussian innovations (see Figure [T]) . This observation reflects the fact that AR processes with 
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Gaussian innovations are time- reversible. On the other hand for ti-distributed innovations this 
phenomenon only takes place for the extreme quantiles (ri = 0.05, T2 = 0.95), meaning that 
^{Xt < qo.ob,Xt+k < go.95) is approximately equal to P{Xt < qo.95,Xt+k < Qom)- This, how- 
ever, does not hold for ri = 0.5 and T2 = 0.05 or 0.95 and frequencies above 0.3, which indicates 
a time-irreversible impact of extreme values on the central ones. Another finding is that in most 
cases the bias is usually larger for the estimation of the Laplace spectrum with ri = T2, see, for 
instance the panels in the diagonals of Figures [T] and [2| 

The corresponding rank-based Laplace periodograms are shown in Figure [3] and |4] corre- 
sponding to standard normal and ii-distributed innovations, respectively. The results show a 
similar type of time reversibility as observed for the Laplace periodogram. It is interesting to 
note that for the rank-based Laplace periodogram the bias appears to be much smaller, and 
smoothing seems to be more effective (see Figures [s] and [4]) 

Finally, we investigate the quality of the estimates by their mean squared properties. In 
Table [l] we present the square roots of the integrated mean squared errors (MSE) . We consider 
two innovation distributions (ti and standard normal) and the smoothed rank-based Laplace 
periodogram for sample sizes n = 100, 500, and 1000. Note that because of symmetry we do not 
display all combinations. For example the spectra corresponding to the quantiles (.05, .05) and 
(.95, .95) coincide in the scenario under consideration. We observe a reasonable behavior of the 
rank-based Laplace periodogram with respect to MSE in all cases. It is interesting to note that 
in both cases the integrated MSE becomes larger if quantiles from a neighbourhood of r = 0.5 
are involved. For example the integrated MSE is increasing for (0.05,0.05), (0.05,0.25) and 
(0.05,0.50) and then again decreasing for (0.05,0.75), (0.05,0.95). This phenomenon is closely 
related to the fact that the empirical copula has variance zero at the boundaries of the unit 



cube, see Genest and Segers 2010 for more details on this subject. 













(n,T2) 








St 


n 


(.05, .05) (.05, .25) 


(.05, .5) 


(.05, .75) (.05, .95) 


(.25, .25) (.25,.5) 


(.5,.5) 




100 


0.0206 


0.0411 


0.0465 


0.0406 


0.0221 


0.0646 


0.0842 


0.0872 




500 


0.0086 


0.0191 


0.0223 


0.0195 


0.0102 


0.0355 


0.0444 


0.0487 




1000 


0.0055 


0.0122 


0.0143 


0.0126 


0.0066 


0.0231 


0.0287 


0.0320 




100 


0.0217 


0.0422 


0.0472 


0.0412 


0.0236 


0.0666 


0.0863 


0.0939 


tl 


500 


0.0093 


0.0196 


0.0224 


0.0196 


0.0112 


0.0366 


0.0464 


0.0531 




1000 


0.0060 


0.0126 


0.0144 


0.0126 


0.0074 


0.0236 


0.0298 


0.0347 



Table 1: Root Integrated Mean Square Errors of smoothed, rank-based Laplace periodograms, for 
the two AR(1) examples above, and various series lengths. 



5.2 An empirical application: S&P 500 returns. 

The smoothed rank-based Laplace periodogram was computed from the series of daily return 
values of the S&P 500 index (Jan/2/1963-Dec/31/2009, n = 11844), for the same quantile orders 
as in the previous section; the weighting function is given by a Daniell kernel with parameters 
(200,100). Results for the smoothed traditional periodogram are shown in Figure [Sj while 
the results for the rank-based Laplace periodogram are presented in Figure [6j with the same 
convention as described in Section 15.11 
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0.0 0.1 0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5 



T2=0.05 



T2=0.5 



-12=0.95 



Figure 1: Smoothed Laplace periodograms and (scaled) spectral densities defined in (3.3). The 



process is an AR(1) process with J\f{0, 1)- distributed innovations and the sample size is 500. 
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0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5 




0.0 0.1 0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5 



T2=0.05 



T2=0.5 



T2=0.95 



Figure 2: Smoothed Laplace periodograms and (scaled) spectral densities defined in (3.3). The 
process is an AR(1) process with ti- distributed innovations and the sample size is 500. 



21 



0.0 0.1 0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5 




0.0 0.1 0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5 




0.0 0.1 0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5 

12=0.05 T2=0.5 -12=0.95 

Figure 3: Smoothed rank-based Laplace periodograms and (unsealed) spectral densities defined 



in (2.1). The process is an AR(1) process with M (0,1) -distributed innovations; sample size: 
n = 500. 
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0.0 0.1 0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5 



T2=0.05 

Figure 4: Smoothed rank- 



T2=0.5 



T2=0.95 



(2.1). The process is an AR(1) process with t\ 



based Laplace periodo^ams and (unsealed) spectral densities defined in 
iR(l) process with t-i -distributed innovations; sample size: n = 500. 



0.0 0.1 0.2 0.3 0.4 0.5 

Figure 5: Smoothed traditional periodogram, S&P 500 returns 




0.0 0.1 0.2 0.3 0.4 05 00 0.1 0.2 0.3 0.4 05 0.0 01 0.2 
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X2=0.05 X2=0.5 t2=0.95 

Figure 6: Smoothed rank-based Laplace periodograms, S&P 500 returns 
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The non-linear features of that series have been stressed by many authors (see, e. g. Ab- 



hyankar et al] |1997|, |Berg et al.| (20T0I , [Brock et al.| [1992] , [Hinich and Patterson] |1990[ |1985 



Hsieh 1989 , Vaidyanathan and Krehbiel 1992 ). Those non-hnear features cannot be detected 



by classical correlogram-based spectral methods, and hence do not appear in Figure [5| where 
the traditional smoothed periodogram is depicted. They do appear, however, in the plots of 
Figure [6| Whereas the picture for the central quantiles ti = T2 = 0.5 looks quite similar to 
that in Figure [5| the remaining ones, which involve at least one extreme quantile, are drastically 
different, indicating a marked discrepancy between tail and central dependence structures. All 
plots involving at least one extremal quantile yield a peak at the origin, which possibly corre- 
sponds to a long-range memory for extremal events. Imaginary parts are not zero, suggesting 
again time-irreversibility. Such features entirely escape a traditional spectral analysis. 



6 Appendix A: Technical details for the proofs in Section [3] 



In this section we give the technical details for the proofs of Theorem |3.1| and |3.3[ The proofs of 
the results in this section rely on several lemmas. Five of them (Lemma 6.7 



6.6) are general results, the statement of which we postpone to Section 6.3 Two further ones 



6.8, 6.9, 6.10 and 



Lemmas 6.1 



(Lemmas 6.4 and 6.5) are specific to the proof of (3.25) and presented in Section 6.2.4 Finally, 
and 



6.2 are auxiliary results used in the proofs of both (3.12) and (3.25); they 



of (3.12) 



are regrouped in Section 6.1.1 while Lemma 6.3 (also in Section 6.1.1) is specific to the proof 



6.1 Details for the proof of (3.12) 



Recall that the estimate (3.12) was obtained by a combination of Lemma 6.1 Lemma 6.2 and 



(3.14) - (3.15). The Lemmata will be proved in Section 6.1.1 and are also used in a slightly 



modified form in the proof of (3.25), which is the essential step in the proof of Theorem 3.3 



Throughout this section, the notation from the proof of Theorem 3.1 is used. 



6.1.1 Three auxiliary Lemmas 



The following Lemma generalizes ideas from Pollard [1991 



Lemma 6.1 Let Ba,^{x) denote the closed ball (in M'^j with center :k and radius > 0. Assume 
that, for some sequence of real numbers On = o{\), 

An := sup sup \Zn,r,uj{^) - ^^r,a;(^)l = Op(«n)- 

Then, sup^gj-,^ \dn,T,Lu - Sn,T,J = op(an)- 

Proof. Let rn,T,u}{^) ■= Zn,T,u{S) — Z^^^{5). Simple algebra and the explicit form (3.10) of 
^n,T,uj yield 



^ ) 



3.11 



Any 5 G \ Ba^iS^r ui) with distance Z„ := \\6 — S^rojW > o,n to S^ru} '^^^ be represented 

asS = 5^ + /„,r,a;dn,r,a;, where dn,T,UJ ■= In^rA^ " ^n,T,uj)- The point 6* = 6^ + andn,r,u: 
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is on the boundary of the ball Ba„{S^^^^^). The convexity of Zn,T,uj{S) therefore implies 
Rearranging and taking the infimum over u and (5, we obtain 



> inf >f ln,r,Lo a J {l^d' Q^ dn,r,Loal - 2An) . (6.2) 



for n sufficiently large. Hence, 2A„ < ^d'^^ ^ ^ ^^dn^r,u)(in with probability tending to one, the 
right-hand side in (6.2) is strictly positive, and the minimum of ^n,r,w(5) cannot be attained at 
any S with \d — S^^^^^ \ > a^. □ 

Lemma 6.2 For any r G (0, 1), there exists a finite constant A such that 



By assumption, the smallest eigenvalue of Qnruj is bounded away from zero uniformly inu G Tn, 



lim P( sup ||^;^^,^||oo > Ay/log n) = 0. 



Proof. For any ^ > 0, 



P( sup ||(5;^^,^||oo > Ay^log n) < n sup P(||S„,^||oo > A^n log n), (6.3) 

where S„,^ := nV2^^^^^ = EHi H*,^ with H*,^ := (Q^,^^)-iQ(^^)(r - I{Xt,n < 9n,r}). In 
order to bound the probabilities on the right-hand side of ( |6.3| ), we apply Lemma 6.8, with 
Xn = 2-v/log n and Vn = to each component of S„^^. Let Sn,uj,j and Ht^ujj, 

j = 1, 2, 3 denote the jth components of Sn,oj and tlt,u], respectively. The quantities Ht^ujj form 
a triangular array of centered, m„-dependent, real-valued random variables, and each of them is 



bounded by a finite constant that does not depend on uj. Therefore, Condition 2 of Lemma 6.8 
holds. Next, observe that, for uj £ we have E[S„_i^S'„^] = n diag(l, 4, 4)W„, where 

^ n n 

W„ = - ^^c,(a;)c;(tj)(E[/{X,,„ < < - r^). 

Each entry of Cs(a;)cJ(cL!) is uniformly bounded by 1. Together with Assumption (A3), this 
implies that the diagonal entries of W„ are bounded uniformly in uj and n. Because all terms 
are centered, we have B^^jj ■~'^^nu)j ~ 0{n). Note that '0„(n~-'^/^m^xj^)^/^ = 1. Therefore, 

is of the order Xn^n-n = 0{n^/^) and, since 



6.8 



6.8 



the left-hand side in Condition 1 of Lemma 
V'.^(nm^x^)^/^ = n, that condition holds. Condition 3 follows from the fact that ^/^n — )• oo and 

_ Condition 4 from the assumption that = 0(n^/^~"). Lemma 

therefore applies, yielding 

P(||S„,a;||oo > ^Vnlogn) < P(||S„,<^||oo > 2V6a;„^„) < 4exp(-41ogn) = 4n~^, 
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where Xn^n = Xn{B'^ + ■i/'n("-"^n2^n)^^^)"'^^^ = Xn{B^ + n)^/^ = 0{y/n logn). Consequently, the 
constant A can always be chosen in such a way that, for n sufficiently large, 

The claim follows. □ 



Lemma 6.3 For the Fourier frequencies coj^n £ J'n, let r„((5; r, a;j,n) := Yl't=i ^ti^j'^^^j,r' 
where 

{I{Xt,n <S + qn,r} " I{Xt,n < gn,r})ds. 



Ht{S;T,UJ 



Then, E[rn(5; r, a;j>)] = /„,x(gn,r)(2n) ^YJi=i{c[{ujj^n)6)'^ + ri{T,Uj^n), where |ri(wj,ri,T)| < 
C4||5||^n~"^/^ for some finite constant C4. Moreover, if \\8\\ < ^logn, there exists a positive 
constant Ci such that, for sufficiently large n, any t and n, 

Var(r„(«5;T,a;j>)) <n-V2Ci||5f. 

Proof. Assumption (A2) guarantees that all calculations that follow still hold when distributions 
depend on n. Due to ?n,„-dependence, 

n n n 

Var(r„(5;r,a;)) = ^Var(Ft(<5;r,L^))+ ^ Cov(i7t, (d; r, u;), i7t,(<5; r, a;)). 



t=i 



Note that 

E[/7t(<5;T,a;,>)2] 



tl=l l<t2f^ti<n 
\t2-ti\<m„ 



E 



E 



Jo Jo 



(/{Xt,„ < U + Q'n^r} - I{Xt,n < ^n.r}) 

X iI{Xt,n <V + qn,T} - I{Xt,n < Qn.r}) dudf 

{I{Xt,n <{uAv)+ qn,r} - I{Xt,n < (u A 0) + qn,r} 
-I{Xt,n < A 0) + qn,r] + I{Xt,n < gn,r})dudu 

{uAv — uAO — vAO) fn,x{Qn,T) + f2{u., V, T)dndf (6.4) 



3 ^^'^fn^x{qn,T)\c't{u)j,„)Sf+r3{ujj^n,r), 



(6.5) 



where |r2(n,f,r)| < Ci {u'^ + f^), hence |r3(Li;j^„, t)| < C2||5||^n ^. Equality (6.4) follows via 
a Taylor expansion, (6.5) from the fact that {u A v — u A — v A 0) dudv = 3 1 x ^ . Similarly, 



E[Ht{S;T,ujj^n)] =E 



{i{Xt,n <U + qn^r} " I{Xt,n < g^.r}) 
ifn,x{qn,T)u + r4(ti, t)) du 



dii 



(6.6) 



fn,x{Qn,T) , 1/ \ s\2 , / \ 



2n 
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where |r4(n, r)| < Csu^, hence |ri((^j_„, r)| < C4||5|pn Thus, 

/I \ 2 

E[ift((5;r,a;j,n)]^ = n"^ (^-/„,x(gn,T)(ct(t^j,„)(5)^j + r5(a;j,„, r), 

where |r5(a;j^„,, t)| < Csdl^H^ + ||(5||^)n~^/^. For the covariances, we have 
E [Ht-^ {S;t, Uj^n) Ht^ {S; r, ujj^n)] 



E 







{I{Xt^^n <U + qn,T} - I{Xti,n < gn,r}) 

X {I{Xt^^n <V + Qn^r} - I{Xt2,n < Q'n.r}) dudv 







r6(ii, r)diidw 



(6.7) 



where \rQ{u,v,T)\ < Cq{u +v ), hence \ri{u,v,T)\ < Cj\\S\\ n , equahty (6.7) follows via a 



Taylor expansion and some straightforward algebra. From (6.4), (6.5) and (6.7), we obtain 



1 " 

Var(r„(<5; 

)) = -JJ^fn,x{qn,T) ^ \c^{uj^n)Sf + Rn, 



t=l 

with \Rn\ < Calldll^mnra""'^ for sufficiently large n, and 

J2\<{u;,,n)Sf < ^|||c,K„)|U V3||<5|||' < 3'/'j2 
t=i t=i t=i 

This completes the proof. 



□ 



6.1.2 Proof of (3.14) 



Applying Knight's identity ( |Knight| (1998] ; see p. 121 of |Koenker| [2005] ) to ([3^ and 

we obtain 



where 





= -S'n- 




n „j 

-u 


Zn,T,LU,li^) 


= —5'rr 




n 



t=l 

-1/2^' (, 



{l{Yt < Qr + S} - I{Yt < qr})ds, 



t=l 
'l/2f,' (, 



{l{^t,n < qn,T + S} - I{Xt^„ < qn,T})ds. 
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Let us show that Zn,T,ui,i and Z^^^ ^, i = 1, 2, are uniformly cfose in probabihty. For i = 1, note 
that, with probabihty tending to one, for any sequence of positive real numbers rjn, uniformly 
over ll^ll < A\/log n, 



\Zn,r,u.,l{S) - Z^,r,u,liS)\ = n^^/^ | ^' ^ Q (c^) < - " /{^t,n < qn,r}) 

t=l 

1 " 

< Ay/n logn - ^ (^/{| A,n| > Vn} + I{\^t,n - gn,r| < ??n + IQt - gn.rl}) , 
i=l 

since I{Xt^n < Qr - A,n} - I{Xt,n < Q'n.r} / implies \Xt^n - Qn^rl < | A,n| + {Qt " gn,r| which. 



in turn, implies \Xt^n — Q'n.rl < ''?n + kr — ^n,r| or lA.nl > ??n- Taking expectations, part (3.2) of 



Assumption (Al), the strict stationarity of (A.n) and (Xt^n), and a Taylor expansion yield 
Using similar arguments and the same reasoning as in Section [6.2.1 we obtain 



sup \Zn,r,uj,2{S) - Z:^^^^^^2i^)\ = Op((k„ + ?]„ + r„(0(K„ + ?7„),m„))v^nlogn), 

||(5||<A-v/logn 

where the function r„ is defined by 

r„(a„,m„) := C72n"i/2(m„a„ + V a„)'/='m^/3n-V3(logn)3)i/2(logn)i/2_ (g g) 

In order to complete the proof, let us show that \qr — (?ra,r| = 0(t/„ + k„). Observe that 

|P(Xi,„ + < t) - P(Xi,„ < t)| < E[/{|Xi,„ - t| < r/„} + I{\Di^n\ > Vn}] = 0{r]n + K„). 

Thus, ||Fy — F„^x||oo = 0{r]n + Kn). Let g be strictly increasing, and h increasing, on [a,b], 
with \g{x) — g{y)\ > c\x — y\ for some c > and sup^gj^ [(/(t) — h{t)\ < L. Denote by the 
generalized inverse of h on [a, 6] (namely, h~^{p) := inf{t|/i(t) > p}). Then, 

sup \h-^{t) - g-^{t)\<2L/c. 

t(i[g{a)+2L/c,g{h)-2L/c] 

Letting g = Fn^x,h = Fy, and taking into account the fact that fn,x > 0, hence Fn^x strictly 
increasing, on [F~]^{t) — d, F~^{t) + d], we thus obtain 

kn,T - QtI = 0{r]n + Kn), (6.9) 

which completes the proof. □ 



6.1.3 Proof of (3.15) 



Due to Knight's identity, we have 

n 

K2n{d;T,L0) := Z^.,^(<5) - Z^^.^Jd) = ^Wt,niu^,S), 

t=l 

with 

Wt,n{^,S) := {l{Xt,n < S + qn,r} " I{Xt,n < qn,r})ds - -^"'^^^"'"^ {S'ct{oj)) 
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Direct calculations yield, for some finite constants Ci, C2, C3 and n large enough 

|3„-3/2 



sup sup|E[Wf,„(a;,5)]| < Ci||d||'^n" 



sup sViY>\Wt,n{^,5)\ < C2\\S\\n'^/^ a.s., (6.10) 



sup supE[\Wt^n{oo,S)\P] < Call^f 



(6.11) 



and, for n > uq with no € M independent of t and tj. 



sup \K2n{a;T,uj) - K2n{b;T,uj)\ < 3vn||a - 

It is obviously possible to construct = o(n^) points di, ...,dj\[ (the dependence of the points 
on n is not reflected in the notation) such that for every S £ {S : ||5||oo ^ A^/\ogn} there exists 
an index j{6) for which \\S — (^^(5)11 < n~^/^. The computations above then show that 

sup sup \K2n{S;T,u})\ < sup sup \K2n{dj;T,io)\ + Op{n'^). 

||<5||oo<AVIogn ujeTn j=l,...,N 

Since #J>i < n, 

P( sup sup \K2nidj; T, u})\ > an) < Nn sup sup P(|-fC2n('^j;i",w)| > a„). (6.12) 

UJGTn j = l,...,N UieTn j = l,..;N 

Let us show that, for a sequence a„ with a„ = o((n^^/^ V n^-'^/'^m^^'^)(log n)^), we can make 
the probabilities in (6.12) tend to zero as fast as n~^, for any I? G IN, which is fast enough to 
compensate for the factor nN = o{n^) and hence will complete the proof. 

For this purpose, we apply Lemma 6.8 again. Fix u and dj, and observe that the collection of 
random variables 

Vt,n{i^,dj) := n^/\logn)-^/\Wt,n{uJ,dj) - EWt,n{uJ,dj)), t = l,...,n 
are centered and m„-dependent. Note that, for \\S\\ < A^/log n, we have 



sup sup\Vt,n{uj,d)\ < ^^2(1 + 0(1)), sup supE[|Vt,„(a;,5)|^] < A^'Csn-^/^lognY^'' , (6.13) 



a/2 



and, as a consequence of (|6.10|), (|6.11|) and Lemma 6.3 in Section 6.1.1 

pE|( > ]VUuJ,d)'' 



sup supe[(VT4.„(w,<5))'1 < A^C4n^/\logn)^/\l + o{l)). 



Let Xn = Dy^log{n) and tpn = {n ^^^"i.^^ V sup4(E|"l4^„(a;, 5)^)-^/^) logn. Since n ^^^ml/^ is 
(-)^^-i/4-a/3) supt{E\Vt,n{oj,S)fy/^ is ©(^-^/^(log n) ^6)^ ^„ ig 0{n~^/^ (logny/^) , hence 
0(1). In view of ( 6.13| ), the sufficient condition in part (ii) of Lemma |6.8| is satisfied, so that 
Conditions 1 and 3 of Lemma 6.8 hold. Obviously, Condition 2 also follows from (6.13). Because 
of the definition of Xn and the assumption that m„ = 0(n^/^~'*), Condition 4 holds as well. It 
thus follows from Lemma 6.8 that there exists a finite constant Cd such that, for sufficiently 
large n, 



P(\Y,Vt,n{u;,dj) > C^((nlogn)i/2 v(ni/V/3(iQg^)io/3))i/2j < 4^^"^ (^i + ^(^i)^ 



29 



Setting 



an ■■= n 



-i/2(logn)i/2cB((nlogn)V2 v (nV3^4/3(iog^)io/3))i/^^ 



1/2 w rr,V3^4/3/. ^„^10/3^^1/2 



we have a„ = o((n ^/'^ V n i/3?Ti^^'^)(logn)'^); it thus foUows that 

F {\K2n{dj]T,uj)\ > an) < ^(Wt,„(a;,(ij) - ¥Wt^n{^,dj)) > a„ - nsup |El^t,„(a;, 

<p(|^^i,n(^>'^i)| >ni/2(logn)-VV-0(logn)) < 4^-^(1 + o(l)) 
t 

This completes the proof. 



□ 



6.2 Details for the proof of (3.25) 



Subsections 6.2.1-6.2.3 contain the proofs of (3.27) - (3.29) that were b asic in estabhshing (3.25 ). 



Some auxiliary results used in the proofs are coUected in Section 6.2.4 Denote by F„^y and F„ x 



the empirical distribution functions of Yi, Yn and Xi^n, ■ ■ ■ , Xn,n, respectively. Throughout 



this section, the notation from the proof of Theorem 3.3 is used. 



6.2.1 Proof of (3.27) 



From Knight's identity, we have 

Zn,T,u>{S) = Zn,r,uj,l{S) + Zn,r,uj,2iS) and Z^^^^(5) = Z;^^_^^i(5) + '^^^^^^^i.^) , 

where 

n 

Zn,r,.AS) := -5'n-i/2^Q(^)(r-/{y,<F-^(r)}), 

t=i 

|n,r,.,2(5) := {l{Yt<F-^{s + T)}-I{Yt<F-l.{T)})d.s, 

t=l -^0 

n 

t=i 



Zn,T,u],li^) 



The assertion in (|3.27|) follows if we can show that Zn,T,Lu,i and Z^^^- are uniformly close for 



i = 1,2. For i = 1, note that, with probability tending to one, we have, for any e > 0, 

\Zn,T,uj,li^) - Zn,r,cj,liS)\ 

^' Yct{u:){I{Xt,n < F-},{t) - A,n} - I{Xt,n < ^^^^^(r)}) 

i=l 



<^Vn-ilogn(^/{|A,n| >Vn]+ sup <??„}) (6.14) 

N-i^„:^(-)i<et=i 



t=l 



for any sequence of real numbers {r]n)i where the inequality is due to the fact that 
I{Yt < F-1.{t)} - I{Xt,n < Kl^ir)} + implies |A,n| > ??n or \Xt,n - i^„"y(r)| < r/„, along 
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with the fact that, by Lemma 6.4, -Fn,x(-^„ y (''")) — t = op(l). By (3.2) in Assumption (Al) and 
the strict stationarity of the process {Dt^n), the first sum in ( |6.14 ) is of order Op{Kn\/nTogn) . 
The absolute value of the second sum in (6.14) is bounded by 

I " 

Ay/nlogn sup - ^ {l{Xt^n < S + ??n} - I{Xt,n < S- TJn}) 

\s-F'],{r)\<e'' t=l 



< A^/n^ogn sup sup \Fn,x{s + x) - Fn^xiv) - Fn,xis + x) + Fn,x{y)\ (6.15) 

\s-F~\^{T)\<eX:\x\<2rin 



+ n log n sup 

\s-F-],{r)\<e 



(6.16) 



Therefore, it follows from Lemma 6.9 that (6.15) is of the order ^/nTogn rn{2r]n,mn)- For 
the second term, a Taylor expansion yields the order 0{rjn\/n logn). For i = 2, note that 



where 



4i J-^) ■■= E / (^i^* ^ ^n";y + r)} - I{Xt,n < F-}{s + r)})d. 



t=l 



X (/{O < s < c;(w)5} - /{O > s > 4(a;)5})ds, 



t=i 



For any e > we have, with probability tending to one. 



p2\\S\\ " 

l4^L(^)l < / j;(/{|A,n| >r?„} + /{|Xt,n-F-^(r + sn-i/2)| <r?„})d. 

J-2\\s\\ trf 



n 



< 411^11 ^ /{|A,n| >r/„}+n-V2 sup E " ^1 ^ 

i'"--p'„:xWi<^t=i 



and 



<ll'5||(n-i/2^/{|A,n|>r?„} + 



n 



-1/2 



sup E ^{l-'^t.n - ■W| < r]n} 



t=l 



\^-F~xM\<^ t=l 



Since the supremum in (3.27) is over \\6\\ < A^/k)gn, the upper bound for | Ai"|r,cj('5)| and |^ntT,a;(5)| 
is of the same order as for |^n,T,w,i(^) — Z^tw i(^)I above. This completes the proof. □ 



,(2) 
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6.2.2 Proof of ( |338| ) 

Plugging into (3.28) the definition of Z^^^ it remains to show that [recall that ct^i{co) = 1] 



max sup 



n 



-1/2 



Y,Ct,k{^){l{Ut,n < Fn,x{F-l.iT))} - I{Ut,n < t}) 



t=l 



Op{n-^/^ml/\lognf^^) (6.17) 



and 



n 



-1/2 



Y.{I{Ut,n < Fn,x{F-^l^(.r))} - I{Ut,n < t}) - Vn{Fn,x{F~l.{T)) - T 



t=l 



Op(n-i/^my2(logn)3/2). (6.18) 



First consider (6.17). Since, by Lemma 6.4, |-Fn,x(-^„ y (''")) — ''"I = Op{n ^/^-^/log n), we obtain 



sup 



n-^/2^Q,fc(L^)(/{C/<,„ < F„,x(F~^(r))} - < r}) 



t=i 



< sup n 



-1/2 



sup 



i^&J^n \x—T\<n -"-/-^logn J— ]^ 



^ Q,fc(a;) (/{[/*,„ < x} - I{Ut,n < r} - (x - r)) 



sup n Mogn y^Cf,fcO 



(6.19) 



t=i 



for A; = 2,3, with probability tending to one. The second term in (6.19) vanishes, because, 
for all uj £ Fn, X]"=i *^os(a;t) = X]"=i — 0- order to bound the first term, cover the 

set Z := {u : \u — t\ < n~^l'^ logn} with N < n balls of radius 1/n and centers ni, un S Z, 
and define Gn,ui,k{u) := n"^/^ ^^ILi ct,fc('^)(-^{C^t,n < - u)- Then, 

sup sup sup \Gn,ui,k{u) -Gn,oj,k{uj) 
j i^GJ^n \u—Uj\<n-'^ ' 
n 

< supn-^/2 (l{Ut^^ <u + 2n-^} - I{Ut,n <u- 2n-^} + 4n-^^ + 0(n-^/2) 



t=i 



< sup F„ u(uj + 2n-i) - F„ c/(nj - 2n-^) - 4n"^ + 0(n"^/2), 

i=l,...,Ar I 



where the latter bound, in view of Lemma 
o(mnn~^/^(logn)^). Thus, 



6.9 



is op(n ^1^^ since -\/nr„(4n ^,mn) is of order 



sup sup sup 



G„,(^,fc(^i) - G„,(^,A:(%) =op(n ^Z"^), /c = 2,3. 



and therefore 



max sup 



n 



-1/2 



^Q,fc(u;) (/{[/*,„ < Fn,x(i^-y(r))} - I{Vt,n < t}) 



t=l 



< max sup sup 

fc=2,3 j=l,...,N ujeT„ 



Gn,u.M^j) - Gn,uM^) +op(n-i/4). (6.20) 
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Now, by construction, maxj \uj — t\ < n ^/^logn. Moreover, 

n 



t=l 



where Vn,t,uj,k{uj,T) := ct,ki^^){l{Ut,m„ < uj} - I{Ut,n < t} - {uj - r)) are centered, m„- 
dependent random variables. Direct calculations show that, for some finite constant C indepen- 
dent of n, Lo, T and j. 



\Vn,t,uAuj^^)\ < 2 a.S., ^Vn,t,u,k{Uj,T)\^ < C\uj - t\ < Cn ^/^log 



n, 



and 



n 

^^{y^^Vn,t,u,k{Uj,T)y 
t=l 



< Cn^^'^mri loe 



n. 



An application of Lemma 6.8 with Xn = A\/log n and ipn = C^^^n ^/^logn thus yields, for 
k = 1,2, some finite constant C and n sufficiently large, 

n 

sup sup F{n-'/^\y2Vn,t,u,k{uj,T)\ > Cn^'^^y^l^in^/^mnlogn)^/^) < 4e-3l°g-. 
i^eJ"„ j=i,...,Af j^]^ 

Hence, in view of the fact that N < n and #J-n < n, 



max sup sup 

k=^,5j=l,...,Nui€Tn 



Together with (6.20) this yields (6.17). Turning to (6.18), Lemma 6.9 yields 



n 



-1/2 



{l{Ut,n < FnAKyi^))} - nUt,n < t} - (^"^ W) - t)) 



t=l 
< 



sup n 

|m— r|<7i~-'-/^ log? 

n^/^ sup 

\u—T\<n~^/^ log? 



'1/2 



5^ {l{Ut,n <u}- I{Ut,n <r}-{u- r)) 



t=l 



\Fn,uin) - Fn,uir) -iu-T)\= Op(n-i/4my2(iogn)3/2). □ 



6.2.3 Proof of ( |3.29D 

Observe the decomposition 

™ /.n-i/2cj(w)(5 



|^r,a.,2(^) - E / (^{^*'" < 5 + r} - I{Ut,n < r})ds 

t=i -^0 



n /.n-i/2cj(u;)5 



(/{^7t,„ < FnMKyi^ + HUt,n < Fn,x{F-^Y{rm - I{Ut,n < S + t} 

+ I{Ut,n<T})ds 



2m " 

-2\\S\ 



n ^'^Yl (^if^*." ^ Fn,xiFn,yiri-'/h + r))} - I{Ut,n < FnAFnyir))} 
t=i 



- I{Ut,n < n-^l'^s + r} + I{Ut,n < r}) (/{O < s < c[{io)6} -l{0>s> c[{uj)S})ds 
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where 



A':U^n,x{KYin~'^'^ + r)), n-V2, + r;s)- si%{F,,,x{F-l.{T)),r; s))ds 

-2||<5|| - , > 

/•2Pi| " 

4'^ =: / n-'/' liFuMKU^-'/'^ + r)) - {n-'/'s + r)) - {F^MKxir)) " r) 

J-2\\S\\ ' 'J 

X l{0<s< c't{oj)S}ds 

J-2||<5|| ' ' . 
/■2||5|| " . -I 

4'^ =: / n-y' (i^n,x(F-^(n-i/2s + r)) - (n-V^, + ^)) _ (F„,x(F-^(r)) - r) 
■^-2||5|| ^ L ' 'J 

X /{O > s > Ct{uj)S}ds 

and 

n 

t=i 

n 

t=l 

First note that, in view of Lemma 16.41 



< m\V^ sup |F„,x(i^„"y(n)) -u- (F„,x(^-y(r)) - r)| = op(/3„ y^nlogn), 

l«-^l<2||5|l/v^ 

with /3„ := Km + f?n + fniVmfnn) + 0(n^'^/'^my ^ log n) . A si milar bound can be obtained for 



6.4 



Next, for sufficiently large n, still in view of Lemma 

f2||<5|| 

/ H^siFnMF-yin''^'^ + T)),n-'/'s + r; .)|d. 

J-2\\S\\ 



m 



^-2||5|| t,:|t,-T|<2l|5||/v^ 
/•2||<5|| 

< / sup sup |S; j^(u,^;;s)|ds 

J-2||<5j| t):|t)-r|<2||<5||/v^ u:\u-v\<n-'^/^ logn ' ' 

<4:\\S\\ sup sup sup \^^nls(.'^^^'^^)\- 

s:|s|<2||(5|| v:\v-t\<2\\S\\/^ n:|n-!;|<n-V2 logn ' ' 

Similar inequalities hold for X^2p|| l^^ri'l s(-^'n',x{FnY('''))^'^-' ^)\'^^- ^s show that 

sup sup sup sup g{u,v; s)\ = Op{n~^^^ml/^ logn). (6.21) 

(-'eJ'n d:\\S\\<A^/I^ s:\s\<2\\S\\ {m,i,):|j;-t|<2||(5||/v^ ' ' 

\u—v\<n~^^^ logn 

For any C > we have /{O < s < c'^S} = /{O < Cs < Cc'^S}. Thus, it is sufficient to consider 
vectors <5 satisfying \\d\\2 = 1. Since by definition ||ci(a;)||2 = y/2, it also is sufficient to consider 
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values of s in the interval [0, \/2]- Finally, note that if /{O < si < c^<5i} = /{O < S2 < ^^[^2} for 
all t = l,...,n, then also S^"^ (u, u ; si) = ^^(n, f ; 52)- We thus can rewrite (6.21) as 

G„ := sup sup \Sl,+\u,v;T)\ = Op{n-^/^mi/^logn) (6.22) 

TeM„ {u,v):\v-T\<2\\S\\/y^ 
\u—v\<n^^^'^ logn 



where 



Mn ■■= {T = {tG {l,...,n} : < s < c[S}\uj G J"„,s € [0, \/2], = l} (6.23) 



and 



~^i+Ku,v;T) := n'^/^^ {l{Ut,n < u} - u - iI{Ut,n < v} - v)) =: n-^/^Y^^tA^, 



In order to prove (6.21) (or ( |6.22 )), define the set 

Z := {{u,v) G : l-u - f| < n~^/^logn, \v - t\ < 2An^^^'^ y/logn] 

and cover it with N < "n? balls of radius 1/n with centers zi, .■■■,zn G Z. For any {u,v) G Z 
there exists an index j such that ||(m, w) — {zij,Z2j)\\oo < I/^t- and, letting Zj := {zij,Z2j), 

p{u,v,Zj) :=\S';^\u,v;T) - S,^^'^ {zij, Z2j;T)\ 

n 

< {l{\Ut,n - Zlj\ < n-^} + I{\Ut,n - Z2j\ < n-^} + \U- Zlj\ + \V- Z2j\) 



t=l 



< 2n-i/2 + n-V2 Y {l{\Ut,n - zi,\ < n-^} + I{\Ut,n - Z2j\ < n-^}) 



t=i 

n 



+ I{Ut,n < Z2j + - /{C/t,„ < Z2i - n-1}) 
< ni/2(F„,c7(zij + 2n-i) - {zij + 2n-i) - {Fn,u{zij - 2n-^) - {zij - 2n-^)) 
+ Fn,u{z2j + 2n'^) - {Z2j + 2n-i) - {Fn,u{z2j - 2n'^) - {z2j - 2n-^))) + 0{n-^/^) 



where i^n,(7 denotes the empirical distribution function of Ui^n, ■ ■ ■ , Un,n- From Lemma 



6.9 



sup sup \p{u, V, Zj)\ < n^^"^ sup \Fn^u{zij + 2n~^) — Fn^u{zij — 2n~^) — 4n~"'^| 

zi,...,ZN (?i,D)e[o,i]2 Zj<^z 

\\zj-{u,v)\\oa<'n.~'^ 

+ gup \F^^^{z2j + 2n-^) - Fn,u(z2j - 2^"^) - An''^] + 0{n-^'^) 

Zji^Z 

= 0{rnnn logn). 



With this, we have, for G„ defined in (6.22), 



Gn< sup sup |S^+)(zij,Z2j;T)| + Op(m„n ^/^logn). 

TeMn Zl,...,ZM 



Because \M.n\ < (?^ + 1)^ by Lemma 6.5 and < by construction, it follows that 
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P( sup sup Z2j; T)| > n^^/^my^ logn) 

T£M„ zi,...,ZN 

<(n + l)V sup sup F{\Sl^\zij,Z2j;T)\> n'^/^ml/'^\ogn). 

TeM„ zi,...,ZN 

It therefore suffices to show that for some D > 6 and finite constant C independent of T and Zj , 
P{\Si+Hzij,Z2j;T)\ > Cn-i/^my^logn) < e-^i°g" (6.24) 

for every T G A4n and Zj G Z. To this end, note that n^/'^S^\zij, Z2j; T) is a sum of centered 
mn-dependent random variables Vt^nizij, Z2j). Simple computations yield (recall that zj G Z) 



sup SU-p\Vt,n{zij,Z2j)\ < 2, 

sup supE[|I4,„(zij,2:2i)|^] < Sjzij - Z2j\ = 0(n~^/^ logn), 

2l 



(6.25) 
(6.26) 



sup E[(^yt,„(zy,Z2j)) 1 = 0{{#T)mn\zij- Z2j\) = 0{mnn^/^\ogn). (6.27) 



We now apply Lemma 6.8 with rc„ = D-^log n. Because of (6.25) and (6.26), part (ii) of 
Lemma |6.8| implies that Conditions 1-3 hold if we choose 

■= (n-i/Vy^ V (supE|Ft,„(n,t;)|3)^/^)(logn)2/3 = 0{n-^/^ \ogn) . 



Condition 4 follows because m„ = 0(n^/^ '^). Therefore ( 6.24[ ) follows from Lemma 
2^/6ADn-^^^^/k^{Bl + i;ln^/^mj/'^xly/^ = 0[n-^l^m\l'^ logn). 

A similar result can be derived for J ^ . This completes the proof. 



6.8 



smce 



□ 



6.2.4 Two auxiliary Lemmas 

Lemma 6.4 (i) If Kn + Vn+i^nC^Vn, fnn) = o{n~'^/'^) and, for any 5 > such that [a — 5,[i — S\ C 
(0, 1), infug[Q_5_^+5] 

sup |F„,x(i^„~y(n)) -u\ = Op(n-i/2yi^). 
ue[a,,g] 

(a) If, moreover, Kn + r]n + r„(2r/„,m„) + rn{an,mn) = o(a„), then 

sup \Fn^xiF~Y{u))-Fn,xiF^;i^{v))-{u-v)\ = Op (K„+7/n+'^n(2r/n, m'„)+r„(2a„, m„)) . 

u,v&[a,0],\u—v\<an 

Proof, (i) Elementary analytic considerations show that, for any non-decreasing function g, 
s^Pw(^[u,v] \9{w) - w\ < o„ implies sup^g[„+2a„,«;-2a„] \9~^{w) - w\ < an- T his, f or g{w) = 
Fnxi^nxi''^))^ u = a — 6, v = (3 + 6, in combination with Lemmas 
desired result. 

(ii) By Lemmas |6.9| and 6.10, for any bounded 3^ C R, 



6.9 



and 



6.10 



yields the 



sup sup \Fnxiy + x) - Fnxiy) - Fn,x{x + y) + Fn,x{y)\ 
yey \x\<a„ 

= Op{Kn + r]n + r„(2r/„,m„) + r„(a„,m„)). 
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Since, for any A C [0, 1], sup„ \^nx('^)~-^nx('^)\ — Ca\u — v\ for some positive constant Ca, 



sup I Fn,Y {F-'x (n) ) - F„,y (F-j, {v))-{u-v)\ 

u,v(i[a—5,fi+S\,\u—v\<an 



= Op(k„ + rjn + r„(2r/„,m„) + r„(a„,m„)). 

We now apply Lemma 3.5 from Wendler 2011 , with F{w) = Fny{F^\r{w)), I = an-, 

c = D{Kn + r]n + rn{2rin,mn) + r„(a„,m„)), Ci = Fn,Y{Fn,xi^ ~ ^))^C2 = Fn,YiPn,xil^ + '^))- 
By assumption, 

/ + 2c = a„ + 2D{Kn + r]n + ?^n(2??n, "In) + r„(a„, m„)) < 2a„ 



for sufficiently large n. By Lemma 6.9 and 6.10, we have Ci = a + 5 + op(l), C2 = (3 — 6 + op(l) 
and, for any strictly increasing continuous function G, {F o G^^)^^ = G o F~^ (see Exercise 3 
in Chapter 1 of Shorack and Wellner 1986| ); moreover, by part (i) of the present lemma, 
Fn,x{F~Y{u)) is uniformly close to u for large n. Hence, 

sup \Fn,x{F~Y{u))-Fn,x{F^^Y{v))-{u-v)\ > D{K,n+r]n+rn{27]n, mn)+rn{2an, rUn)) 

u,v&[a,l3],\u—v\<2an 

implies 

sup |F„,y(F^]5.(u))-F„,y(F^]^(w))-(u-u)| > D{Kn+r]n+rni2r]n,mn)+rn{an,mn))] 

u,v£ [a—5,l3+5],\u—v\<a„ 



part (ii) of the Lemma follows on letting D tend to infinity. 



□ 



Lemma 6.5 The cardinality of the set Ain defined in (6.23) is at most (n + 1)^. 
Proof. Fix a Fourier frequency ujj^n = 27rj'/n G and note that 



Ct{ujj^n)'S = 61 + 62 cos(a;j,„t) + 63 sin(a;j,„t) = 61 + ^J 6^ + 6j cos(a;j,„t + (/>((52, (^s)) 

where 4>{62,63) £ [0, 27r] denotes a phase shift. Moreover, for any v G [0,1], noting that x 1— )• 
cos(a;j,n2; + (p) is n/j-periodic. 



{t G {l,...,n}|0 <v <6i + y'5| + 5|cos(a;j>t + (/>)} 

= + w\w £ [Ci,^,„,5 - Co,</,,t,,5,Ci,^,^,5 + Co,</,,^,5] , = 0, ...,n} n {1, ...,n} 

where Co,0,„,5 and Ci^^^^^a denote two real-valued constants (depending on cp, v, 6) with Co,,/,,^,^ G 
[0,n/2j] and Ci^^p^^^s £ [0, Now, we have 

TIjIv Til Jv 

{—j-+v\ve[ai,bi],k = 0,l,...,n]n{l,...,n} = {—r+v\v£[a2,b2],k = 0,l,...,n]n{l,...,n} 

provided that [jai] = [^02] , \jbi~\ = \jb2'] where [a] denotes the smallest integer larger or equal 
than a. The argument above holds for any Fourier frequency. In particular, it implies that 



Mr 



c |r = |t G {l,...,n}n ly + w G [ 



,a — b a + 6, 



}}| 



b = 0, \n/2], a,k = 0, j = l,...,n|. 



Since the set (of sets) on the right-hand side of the above equality contains less than (n + 1)^ 
elements, the proof is complete. □ 
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6.3 Five basic lemmas 



Lemma 6.6 Let {Xj^n)j=i,...,n be a triangular array of uniformly bounded p-variate random 
variables, p G M, such that the sequences {Xj^n)j=i,...,n are rUn-dependent for every n E IN. 
Let Tin be the covariance matrix of Sn '■= XlILi -^^n and assume that the limit Sq := lim„_>oo ^^n; 
possibly singular, exists. Ifrun = 0{n^) , for some 6 G [0,0.25), then n~^^^{Sn—^{Sn)) is asymp- 
totically Mp{0, So). 

Proof. For the proof of the assertion consider X'Sn and apply the Cramer- Wold device. The 
degenerate case is proved by applying Chebyshev's inequality to establish X'Sn = op{l). For the 
nondegenerate case we apply a modification of the Central Limit Theorem 7.3.1 for uniformly 
bounded m-dependent random variables in Chung Il968| that holds also if m varies with n, such 
that m„ = 0{n^), for some 6 G [0,0.25), and n~^^^^^2^^ Var(5„) —?■ oo. For a proof use the 
blocking factor /c„ := [n'^^^~^^^^\ as suggested by Li 2007 . □ 



Lemma 6.7 Let Xi^n, X2^n, Xn,n be a triangular array of centered, rUn-dependent, real- 
valued random variables. Define Sn '■= X^ILi -^t,n '^^'^ -^n ■= ^^['5'^]? denote by Xn > 1 a sequence 
of real numbers and assume that 



nin sup \Xt^n\ < Bn/xn a.s., sup E| Xt^„ ^ < OO for all n, and 



t 

nrUnXn m.SiKE\Xt,nf Bn^ 



oo. 



(6.28) 
(6.29) 



o(l) as n 

Then, denoting by $ the standard normal distribution function, 

1 -P(S„ < BnXn) = (1 - Hxn)){l + 0{nmlxlmaxE\Xt^n\^B-^)). 

Proof. The assertion directly follows from Lemma 2 of [Heinrich 1985| . Define the new 
variables Yfc,™ := -'^(fc-i)m„,n + ••• + ^fcm„-i,n for k = 1,..., [n/m„J, and yL„/m„J,n as the sum 
of the remaining Xj^^s. Direct calculations show that the conditions stated above imply the 
conditions of Lemma 2 of Heinrich (19851 . □ 



Lemma 



6.7 



cannot be applied when condition (6.29) does not hold, i.e. when E|Xj^„p is too 



large compared to i?^. A slight modification of the result above allows to handle those situations 
by replacing with a larger quantity. 

Lemma 6.8 (i) Let be a triangular array of centered, rUn- dependent, real- 

valued random variables. Define Sn '■= Yl^=i-^j,n and B^ := £[5"^], denote by Xn > ^ and 
V'n ^ sequences of real numbers, and assume that 

(1) x„mn(supj \Xj^n\ + \/3V'n(n"^/2m^x.^)^/3) < fin := {Bl + '4jl{nmlx^nf/^Y''^ a.s., 

(2) supj E|Xj^„p < 00 for every fixed n, 

(3) supj E|Xj,„|VV'n ^ and n~^/'^mliplxl = 0(1), 

(4) m^x^n^^/^ = 0(1) as n tends to infinity. 
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Then, 



P{\Sn\ > 2\/6x„^„) < 4:eM-xl){l + 0{nmlxlsupE\Xj^nf/fj.l)). 



In particular, the 0{...) quantity does not depend on any property of the distribution of the 
random variables X2,n, -^n,n other than E\Xj^n\^ / fj.^. Moreover, the as- 

sumptions of the Lemma imply that 0(nm^x^ maxj E\Xj^n\^ / fi^) = o(l). 

(ii) It is sufficient, for Conditions (1) and (3) to holdforn large enough, with ijjn = ((n~"^/^my^)V 
(supj E\Xj^n\^Y^^')oin for any a„ — )■ cxd such that ipn = o{l), that sup„supj \Xj^n\ < oo a.s. and 
supj E|Xj^„|^ = 0(1) as n ^ 00. 

Proof. Define Wi^n, W2,n, l^n,n as a collection of i.i.d. random variables (for every n) that are 
independent of Xi^n, ^2,n, Xn^n and have distribution ^„(n~^/^m^x^) ^/^U[-V3,VS] where 



the constant -y/S is chosen in such a way that Yar{U[-V^,V^]) = 1. Define X^^^ 

'^"^^ — StLi^t,™''- '^^6 quantities X2^\ X^^^ form a triangular 



Wj^nJ = 1, ■■■,n and S„ 



array of m« -dependent random variables with the following properties: 

(a) (5(^^)2 := EKsk'^f] =Bl + ^Knmlxlfl^ 

(b) SUp^- \Xf^\ < SUPj + V'n\/3(n-V2^2^3)l/3. 



(c) sup^- E|xj_^)|3 < 7(sup^- E\Xj^nf + 33/2V;3n-V2^2^3) 



Let us show that the results of Lemma 
which we obtain the first condition of 



6.7 



apply to From (a), (b) and (1) 



^6.28) of Lemma 6.7 Condition (2) together with (c) 



yields the second condition of (6.28) of Lemma 6.7 Finally, note that 



< 



nm^ 4 sup Elxj^^P 7nmlx^maxjE\Xj^n\^ + S^/^^j^n ^/"^mlxl 



0(1) 



where the first inequality follows from (c) and the last identity from Conditions 3 and 4. Thus 
Lemma |6.7| yields 



P(5(^) > = (1 - $(x„))(l + 0(nm2x3 maxE|X,-,|3(B(^))-3)). 

Next, observe that 5„ = si^^ — J2k=i ^k,n- Thus 

n 

P(5n>4-")x„) < F{{Si^^>Bi''^Xn/2}u{-Y,Wk,n>Bi^^xj2}) 

k=l 
n 

< P(5i^^ > Bi^^xj2) + P( - ^ W,,^ > 4^)x„/2). 

k=l 

For the second probability, Hoeffding's inequality [see e.g. Pollard (1984), Appendix B] yields 

^ 42 
P{-Y.Wk,n> A) < exp ( - ,^_,.,,^__,,^^^^,^^,,,,J = exp(-6-iA2v^-2n-2/3. 



k=l 



6nV'^(n i/2m2 2:^)2/3 ' 



VTi^ ^ X^ ) 



Setting An = V^x'^'ipnn^^^iT^'n^ , the right-hand side becomes exp(— x^). Finally, repeat all the 
arguments so far with Xj^n and Wj^n replaced by —Xj^n and —Wj^n, respectively. Straightforward 
calculations yield 

P{\Sn\ > 2\/6Si^)x„) < 4exp(-2;2)(l + 0(nm2x^maxE|Xj-„|3(B^^))-3)) 
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and thus the proof of the first part of Lemma 6.8 is complete. 

For a proof of the second part, in order to see that Condition 1 holds, it suffices to ver- 
ify that ninXn < '^n'n^^'^'rrhi'^ Xn since by assumption ifjuin'^^^'^m'^x'^Y/^ = o(l). Now m„3;„ < 
iprin^ ^^nhl^Xn holds iff ipn > n^^^^ml/^ does. Condition 3 holds by construction. □ 

In the next two Lemmas, we denote by Fn,Y and Fn,x the empirical distribution functions 
of the random variables Yi, . . . ,Yn and Xi^n, ■ ■ ■ , Xn,n, respectively. 

Lemma 6.9 Let Assumptions (Al) and (A2) hold. 

(i) For any hounded set 3^ C R, there exist finite constants Ci, C2 such that, for any sequence 
0"n = o((logn)~^) and sufficiently large n, 

P(sup sup \Fn,x{y+x)-Fn,x{y)-Fn,x{x+y)+Fn,x{y)\ >^VK,m„)) < Cm^e"^' " 

yey \x\<an 



where the function rn is defined in (6.8). It follows that 

sup sup \Fn,x{y + x) - Fn,xiy) - Fn^xix + y) + Fn,x{y)\ = Op{rn{an,'mn)). 
yey \x\<a„ 

(a) For any bounded y cM, sup^^zy \Fn,xix) — Fri,^x{x)\ = Op{n'~^/'^ y/logn) . 
Proof. Observe that 

1 " 

Fn,x{y + x) -Fn,x{y) - Fn,x{x + y) + Fn.x{y) = - y^Wn,t{x,y) 

t=l 

with centered, m„-dependent random variables Wn,t{x,y) that satisfy (with probability one) 
^^Pn,t,x,y\Wn,t{^,y)\ < 2, sup„^j_y E| (x, y) | ^ < C\x\, and 

n 

supE[( W„,i(a;,y)) ] < nm„C|x| 
y t=i 

for some finite constant C independent of m„. Set Vn := {{n~^mn) V a„)^/'^logn and Xn = 
D^/logn. Part Lemma 6.8 implies that, for sufficiently large n, 

n 

sup sup P( V]W„,t(f,?/) > nD^r„(a„,m„) j < 6exp(-L'^ log n). (6.30) 

ym.\v\<a„ ' 

Next, cover the bounded set Z := {{x,y) £ H^ly € yj\x\ < with = O(n^) spheres of 
radius ^n~^ with centers {zij,Z2j) G Z,j = 1, ...,N. A Taylor expansion yields 

sup \Wn,t{x,y) - Wn,t{zij , Z2j)\ 

\\{x,y)-{zij,Z2j)\\oo<l/2n 

< I{\Xt,n - Z2j\ < n-1} + I{\Xt,n - {zij + Z2j)\ < n'^} + Csn-^ =: Vtj. 

The random variables Vtj are m„-dependent, uniformly bounded, and have an expectation of 
order 0(n~^). Define Vtj := Vtj — E[Vtj]. It is easy to see that E\Vtj\P < CpU-^ for finite 
constants Cp, p = 2,3, and B'^ := E[( ^"^-^ V^j)^] = 0{mn)- Setting ipn = W^^^mj/^ logn 
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and Xn = Dy/logn, we thus see that {B"^ + ijj'^{nm'^x'^)'^f'^Y/'^ < C4m„(logn)^/^ for sufficiently 
large n. Lemma 6^ thus yields, for sufficiently large n, 

n 

^Wn,t{x,y) - Wn,t{zij,Z2j) > I^^Cs (log 71)^771, 

< 6 exp(— log n). 



sup P ( sup 

j=l,...,N ^ \\ix,y)-izij,Z2j)\\oc<n~'^ 



t=l 



Now (6.30) yields P(^supj=i_ ;v Ylt=i Wn,t{zij , Z2j) > nD'^rn{an,mn)j < 6N exp{-D'^ logn). 
In particular, choosing D large enough, the right-hand side of the expression above is o(l). 
Combining these results with the fact that, by after enlarging C2 if necessary, nD'^rn{an-,mn) > 
D^(logn)^m„ for sufficiently large n, we obtain the first part of the Lemma. The second part 
follows along the same lines. □ 

Lemma 6.10 Let Assumptions (Al) and (A2) hold. Then, for any hounded 3^ C M, 

sup |-Fn,y(s) - Fn,x{s)\ = Op(Kn + Vn + rn{2r]n,mn)) 

with rn{r]n,mn) defined in ( |6.8[ ). 

Proof. Observe that \I{Yt < s} - I{Xt,n < s}\ < /{| A,n| > Vn} + I{\Yt - s\ < ry„}. Thus, 

1 " 

sup \Fn,Y{s) - Fn^xis)\ < - V'/jlA,™! > Vn} + sup -F„,x(s + 2r/„) - - 2r]n) ■ (6.31) 



The ffist term on the right-hand side of (6.31 ) is a.s. non negative; its expected value is bounded 
by K„, and thus the term is of order Op(«;„). As for the second term, we have (recall that, by 
assumption, has uniformly bounded derivative) 

sup \Fn,x{s + 2r/„) - Fn^x{s - 2r/„)| 

< sup |-Fn,x(s + 2r?n) - ^n,x(s " 2r?„) - (Fn,x{s + 2?7„) - Fn,x{,s - 2?7„))| + 0(7?„) 
= Op(r„(2r/„,m„)) + 0(7?n), 



where the last identity follows from Lemma 6.9 This completes the proof. 



□ 



7 Appendix B: Technical details for the proof of Theorem 4.1 



7.1 Proof of 

As a ffist step, let us show that the vectors n^^'^^n,T,ujj „ appearing in the linearity result in 
(3.12) can be approximated by a similar vector with Xt^n replaced by Yt and Qn^r replaced by qr- 
More precisely we show that 

n^/^ sup \\h^^r,ujj,„ - W,T,ojjJ\ = 0p{y/\0gn\f{qr) - /„,x(gn,r)| + Vn{Kn + Vn))- (7.1) 
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To see this, note that 



Jyiqr) - fn,X {qn,T) ^l/2^X 



fviqr) 



n 



fy 



^2n-V2 V hf^'-'A (I{Y, < g^} - J{X,„ < (7.2) 



Since n^^'^h^^^. , by Lemma 6.2, is Op{-/\ogn), uniformly in (jJj^nj the norm of the first term 
in (7.2) is Op(ylogn|/y (qt-) — fn,x{Qn,T)\)- For the norm of the second term, the argument used 
in the proof of ( 3.14[ ) together with (6.9) yields an order Op(-y/n(K„ + r/n)); (7.1) follows. 
Next, note that by (3.12) we have 



n^^'^ sup ||b. 



Putting 



we obtain, from the definition of the Laplace periodogram. 



'j,n ~ ^ (t>n,T,a;j,„) ( ■ ] ^n,T,uii,„ + An 



1 



T'lJ 

Note that, for r G {ti,T2}, 





sup 








sup 






= Op(( 


n-V8 V 



Lemma 



6.2 



and ([7^ imply n^/^ g^p^^^^^^^ ||b„,^,a;,- „ || = n^^'"^ sup^^^^^^^^ \\K,t,uj,J\ + op(l) 



1/2, 



Op(Vlogri), so that ||A„|| = Op{n\\hn,T,ujj^„ - b„,r,a;j „|| • ||b„,r,a;^ „ ||) = Op{Rn). 



□ 



7.2 Proof of (4.5) 



Note that Ln,Ti,T2i^j,n) is the cross-periodogram of the bivariate time series 

{ri-I{Yt<qrA,r2-I{Yt<qr2}). 



(7.3) 



Let ujj^n,^kn £ (0)^) be two Fourier frequencies. From Corollary 7.2.2 in Brillinger [1975| , we 
know that 

27r 

YaT{Ln,ri,T2{^^j,n)) = f 1,1 (Wj>)f2,2 (^^j^n) + — fl,2,l,2(Wj>, -Ulj,n, -^k,n) + 0{l/n) (7.4) 
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and, for uj^n / (^kn, 

Gov [Ln^Ti,T2 {'^j,n)i Ln,Ti,T2 {^k,n)) 



27r 



n 



fl,2,l,2(^i,n, -UJk,n) + 0{l/n^), (7.5) 



where fi^i, ^2,2 and f 1,2, 1,2 are the spectra and cumulant spectra of the bivariate time series (7.3), 
which exist by Assumption (A6). Note that the orders 0(l/n) and 0{l/v?) of the remainders 
in (7.4) and (7.5) hold uniformly with respect to the frequencies. The aforementioned spectra 
coincide with the Laplace spectra fn.n, and fr2,T2 and the cumulant spectra are also bounded 
(see Brillinger [1975 |, p. 26). Therefore, 

t{^k,n)) 



Gov (^Ln,T\ ,T2 (^j,n) ) L'n,Ti ,T2 V 



frijTi ('^j,n)fT2,r2 ('^j,n) ~l~ 

where Rn = 0(1 /n) does not depend on the frequencies. The assertion follows by the fact that 
the variance and the bias of the random variable Kn in (4.5) both are of the order 0(l/n). For 
the variance, note that 



Var(i^„ 



1 



/y(9ri)/y(gT 



■[ Yl ^n(^)Var(V,i,r2(wj+fc,n)) 



|A.i<Af„ 



"■,Ti,T2 (Wj+A;i,n); -t'n,Ti,T2 ('^j+fc2,n)) — 0{l/n), 



\ki\<Nn 



\k2\<Nr, 

k2^ki 



due to the second part of Assumption (A5) and (7.5). As for the bias, E[Kn] = 0{l/n) due to 
the fact that ELn,Ti,T2{^j+k,n) = ^'=('^'^1 > 9T2)e~''^-'+*'"'^ + 0{l/n) uniformly with respect 

to the frequencies (see Theorem 4.3.2 in Brillinger] [1975] ). 



□ 
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